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THE STATUS OF APPLIED PSYCHOLOGY IN THE 
UNITED STATES 


Lewis M. Terjian 

In tlic Aiigust (1920) number of the Psychological Bulletin 
Dr. lloi'ing, .secretary of the American Psychological Asso¬ 
ciation, snniiiKirizes stati.stics on the research fields in which 
39.1 inemheis of the association report themselves to be work¬ 
ing, The .stati.stics include all the members of the as,^oci:i- 
tion except a few who failed to report on this item. A mem¬ 
ber who re])orled two or more licl(l.s was accredited fraction¬ 
ally to each of the fields, which accounts for the fractions 
in the figures given below. Of the 393 reporting, 53 are carry¬ 
ing on no rc.Keai'cli. Tlie remaining 340 are classified as follows 
in Table \T of Dr. Boring’s article: 

I’lF.LD OP Research 

I. Noii-psyclinloRiwl Fields: 

1. Pliilo.soiiliy. 

2. AesLliGlics. 

3. Anthropology_. 

Total. 


II. Chiefly Pine PsyclioloRy: 


t, General psychulogy. 8.7 

5, Experimental psychology. 81.6 

6, Theoretical jisyclinlogy. .37.4 

7, Animal iKychology. 16.5 

8, Psyclmloity and neurology. -12 

Total. M7.-1, or 43,-1% 
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Field of Research Number Accredited —d 


III. Social and Indnslrial Psychalogy: 


9, Social psychology. 

10. "Applied " psychology. 

LI. Industrial psychology. 

6.1 

10.7 

7.4 


Total. 

‘M.2, 

or 7.1< ;, 

IV. Chiefly Edticaliotv. 




54,2 



43.9 


14, Education (including expenmental peda- 

gogy). 

15, Climcal psychology. 

16, Statistical method. 

13.2 

13.7 

1.2 


Total.. 

126.2, 

or 37.1'v;. 

V. Psycfiopalliology ; 



17, Abnormal psydiology. 

18, Psychiatry. 

19, Psychopathology. 

7.2 

2.5 

7,0 


Total. 

16.7, 

or 4.9% 


VI. Miscellaneous 5. or 1. 

Grand Total. 339.5 or 99.9';,’, 

Any classification like that attempted, by Dr. rioriiifr en¬ 
counters certain difficulties which naturally prevent the rcjiults 
from being wholly unambiguous. I believe, however, that his 
data throw interesting light on the amount of rc.seaich whicli 
is being carried on in “ applied " as distinguished from " pure " 
psychology. 

Omitting groups I and VI (non~psycliologlcaI and iiii.scel- 
laneous fields of research) the above table shows 147.4 psy¬ 
chologists accredited to the field designated as "chiefly pure 
psychology," 126,2 to the field designated as "chiefly ethica- 
tion," 24.2 to "social and industrial psychology/’ and 16.7 to 
"psychopathology," The last three groups may be tlirowii 
together as representing the total field of applied psychalogv. 
If these figures could be taken at their face value we would 
have the following division of American p.sycholotii.st.s into 
"pure” and "applied/' 

Group II, pure. 147 . 4 ^ or 47'/, 

Groups III, IV and V, "applied".167.1. or 
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The matter, however, is not so simple. Lines of demaren- 
tloii between research fields are hard to draw and my classi¬ 
fication of the various fields listed by Dr. Boring into “pure " 
and “ aiJplied “ is not wholly satisfactory. The following 
souice.s of error in particular .should be mentioned; 

(1) It is certain that not all of item 8 (“psychology and 
neurology'') can rightly be accredited to "pnre^' psychology. 
Let us assume that half of the 4,2 individuals concerned should 
be accredited to “pure" psychology and the other half to 
neurology. This reduces “ pure ” psychology to 145.3. More¬ 
over, since neurology may reasonably be classified as a iioii- 
psycliological field, our 315 classified psychological workers 
are now reduced to 312.9. 

(2) Doubtless .some will object to classifying social psy¬ 
chology wholly in the “ applied” group. Again we may com¬ 
promise by placing half with " pure ” and half with “ applied " 
])sychology. Thi.s raises “pure" psychology from 145,3 to 
148.35, and reduced “applied" psychology from 167.1 to 
164.05. 

(3) Item 14 i.s classified by Dr. Boring as belonging en¬ 
tirely with the non-psychological subjects. However, since 
the item includes “ ex/)eriniental pedagogy " it is reasonable 
to suppose that a fairly large proportion of the individuals 
concerned could justifiably be grouped under “ educational 
psychology" or "tests," Accrediting half to applied psychol¬ 
ogy and half to the non-psychological fields, the number in 
" applied ’’ psychology is now reduced to 157.45 and the total 
i]uml)er emgaged In (psychological research is reduced from 
312.9 to 306..3. 

On the basis of the above corrections the matter now stands 
a.s follow.s for the 306 nicmber.s of the American Psychological 
Association here cla.ssified as engaged in research in the fields 
of “|)ure” and "applied" psychology: 

" Pure ” p.sychology .. 148,35 or 48.5% 

“Applied” p.sychology .157.4 or 51,5% 

From ihc alvave figures, it appears that considerably more 
than half of the psychological research which is being carried 
on by memlicrs of the American Psychological Association 
(which include.s [jractically all the psychologists of the United 
Statc.s) fall.s in one or another of the fields of applied psy¬ 
chology, The true sitiialioii is probably even more favorable 
to a|)plied psychology if. as the secretary of the association 
sugge.sl.';, Ihcrr is a groalor Icndeiicy for a member to report 
a research fudfl in wliicli he formerly worked but which he 
is gradually leaving than a new field into whld^ his interests 
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are carrying him. To the extent that such a Icndeiicy cxist.s, 
the amount of researcli being done tii the cildcr niul more 
established lines of psychology will of coiir.se lie exaggeraterl 
by the figures. At any rate it is clear that ciinsii.l(M-alily more 
than half the effort devoted to psychological research in the 
United States is in the applied fields. 

This situation has developed almost wholly since l^XX). and 
chiefly in the last decade. As the shift to aji[)liefl psyclicilogy 
still continues, the figures will douhlltvss he even ninre sltilc- 
jjig a decade hence. 

Is this trend unfavorable to psychology as a .scienci'? The 
more conservative will probably so liilcrprcl it, hni f do not 
believe that the history of science warrants this view. (Jne 
has only to recall how such sciences as physiology, ftacleriohjgv. 
chemistry, physics, and biology have been simniluted hv inminn 
needs to realize that a science stands to gain ratluT than 
even as pure science, when it enters the lists in the s»-rvicn 
of mankind. It is unlikely that psychology will prove an 
exception to the rule. 



MINOR STUDIES IN THE PSYCHOLOGY OF 
ADVERTISING. FROM THE PSYCHOLOG¬ 
ICAL LABORATORY OF INDIANA 

UNIVERSITY 


liy Haury Dexter Kitson 

Iniroductivn: The Use of the Historical Method in the Inves- 
tigaiion of Pyobtems of Advertising 

Every time jin advertiser composes an advertisement lie 
faces questions which he would like to have answered. He 
long.s for iiccurate nicasiircments whicli would enable him to 
determine the [irobablc value of various elements in the 
advertiscnieiit. 

01)vionsly the lime to make these measurements is after 
tlie advertiscniLMit is completed and sent on its mission, In 
secliini,'^ the answci’ to any qliestion regarding" advertising 
procecltire, the innst reliable way is to make actual trial of a 
method aiul keep track of returns; to try. out another and 
kee[) track of returns. By successive trials of different meth¬ 
ods and by cnm[)aris()n of returns from each, to arrive at a 
conclu.sion showing which method is mo.'5t effective, 

This .scientific " investigation of returns," however desir¬ 
able it may he, is many times not feasible. The returns from 
many forms of advertising, such as bill boards and car cards, 
do not come in mea.surabJe (jiianlities. Moreover, tlie com¬ 
ponents of an advertisement arc so numerous that it is clifli- 
cult to isolate the several items and discover what j^art of the 
rctum.s i.s due la each. Finally the expense of experimental 
campaigns i.s very grciit. Altogether, despite its desirability 
the method can hardly be employed in wholesale fashion. 

A substitute has been proposed in the “laboratory method," 
according to which conditions are arranged as nearly as pos¬ 
sible like the conditions of the market; subjects are chosen 
typical of Ihc pnxspective readers of the advcrtLscmciit; and 
measures are nhlaincd of their reactions. In this manner vari¬ 
ous devices may he tried out before being tised on a large 
scale. This metliod seems to promise good results; it may 
un(|iiesti()nubly (brow light upon many questions, .such as legi¬ 
bility of variou.s type-faces, appro|>riateness of various colors 
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and shades. With many problems, however, it can liaixlly lie 
used effectively owing perhaps to the artilicial a[niii!i[ilu're of 

the laboratory. , 

But we have not exhausted the po.ssilnhnes oi .‘^rientilic 
measurement in advertising. In case tieiilier of I lie ahove 
methods is adaptable, we may secure light friiin si ill .iiKjiher 
direction. Our aim, be it rciuciiibered, is to disiuiver with 
scientific accuracy the most effective way lo <h) a thing lii fore 
we proceed to do it. If wc cannot accimipHsh this in tiui 
market or in the laboratory we may turn lo tin- cxpcrii.'iices 
of other advertisers who have faced our pidldeiii, ami liy 
observing their solutions wc may govern our juoccdure. 

How discover their experiences? To ask tlieiii would evoke 
contradictions and opinions of varying degrees of rcliriliiliiy. 
Furthermore, since we seek scientific fonmilalioiis of our 
facts, we must have figures instead of opinions. How sliall 
we reduce the experiences of advertisers to numerical terms? 

The answer is, Go to actual advertiscinent.s. As the reposi¬ 
tories of advertising experience they picture the IkmuI of 
progress and provide guide posts showfing the location (if pit- 
falls and pointing out the directions in which success has 
been attained, Such an approach to the in-obleins of adver¬ 
tising is called the “historical method.” It is very simple 
to describe and operate, ihougir It naturally re<[iiii'('s ilic same 
care and caution that scientific nuihod ever ilcmmuls. In 
employing it wc must first state our prohlcm in llif form of 
a question; then go to the fibs of newspapers uiul inagjw.iucs 
such as exist in almost every library of pai’ts. Ainrmg ihc 
advertisements contained therein we must .search for tlic 
answer to our question; then we may tabulate our results and 
express them graphically. 

In employing this method we make use of .several assump¬ 
tions : 

First, that the practises which have persisted over a period 
of years have probably been of value. We judge that those 
firms which did not follow these practises did not make euoiigli 
money to enable them to continue to advertise, or that those 
firms which did continue to advertise discovererl the differ¬ 
ence between valueless and valuable practises and arloplecl tlie 
latter. 

AVe must not assume that advertisers made these changes 
as a result of conscious discoveries. They worked mainly 
by trial and error, As we shall see in graphs lo he inesenled 
later, they discovered the usefulness of various praetises only 
after long-extended periods of experimentation. 
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We may regard modern adverlisiiig practises, then, as pro¬ 
ducts of unconscious evolution. In the struggle for existence 
in the world of puhlicity, certain features have survived be¬ 
cause of certain psychological elcnieiiLs of strength and fitness. 
They exemplify a sort of economic “survival of the fittest," 

A second assumption we make in utilizing the historical 
method is that if advertisers had studied the practises of their 
predecessors they might have avoided some errors and elim¬ 
inated n'meh wastage. And we assume that by surveying the 
practises of the |)ast and by discovering which ones have 
survived and which have failed, we may modify our prac¬ 
tises and find a shorter an<l more economical road to ef¥ec- 
tiveness in advertising. 

We repeat that we are not proposing the historical method 
as a forimila for the solution of all advertising problems, We 
advocate it merely as one form of scientific investigation which 
will enable us to supplement and corroborate information 
secured by other means. 

We shall now offer the results of a series of investigations 
which will demonstrate the utility of the method, and will 
reveal facts about advertising practise of practical value to 
present-day advertisers. 

I. Amount aud Rate of Increase in llic Use of Full-page 
Adverliscmenls 

As one evidiMice of the growth of advertising, people often 
point to the increase in the use of full-page advertisements, 
They fail to give their conleiuion its greatest possible weight, 
however, because they do not present supporting figure-s. Tlic 

TABLE I 

Showing riin Numukh or I^Ji.i.-rAGE Advertisements (Exclusive or 
Cover) in the Literary Digest from 1910 to 1919 


Year 

Panes Devoted Lo 

Full-page 

Per Cent 


Advertising 

Adverliscnrcnts 


1910 

1190 

117 

10 

1911 

1188 

108 

9 

1912 

1274 

182 

U 

1912 

141)8 

264 

17 

191 ■! 

1584 

252 

16 

191[i 

1789 

225 

Ifl 

1910 

2118 

670 

31 

1917 

2718 

972 

36 

191K 

2.597 

1162 

45 

*1919 

2121 

1155 

54 

‘0 iiiDiilhs. 
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writer undertook to supply these by investigating advertising 
records for ten years back in one periodical—T/ve Literary 
Digest. The ratio which the full-page advertisements bear to 
the total number of pages devoted to advertising was com¬ 
puted, (A double-page advertisement was counted as two 
singles.) Results are shown in Table I and Figure 1. 

From these results we may state positively that the number 
of full-page advertisements has increased five-fold during_ the 
past ten years. Though these figures may not seiwe precisely 


01, _ ... fi a UTS. I. . — . — -- ■ f 

' , . ■ ' ' ■ . 11 . 
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for all periodicals, still they are derived from a study of a 
representative general magazine, and they are surely indi¬ 
cative of the trend of development. 

Our figures give further light upon the growth of adver¬ 
tising in general, As seen in the table, the total number of 
pages devoted to advertising in this periodical more, tlian 
doubled during the past decade. The gross number decreased 
in. 1918, due probably to exigencies of war economies. It 
should be noted, however, that the ratio of full-page adver¬ 
tisements to this total did not decrease; it even increased. 
Altogether, we have here numerical confirmation of the state¬ 
ment that full-page advertising has increased, and strong indi¬ 
cation that advertisers consider it a paying investment. 
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II. Amount and Rate of Increase in the Height of l-Icodlitics 
in FuU-f>agc Advertisements 

Starch presents (page 40, Advertising) a table showing the 
increase in the height of headlines during the period 1870- 
1910, in which he shows that the height increased from 6.6 
millimeters (approximately 24-i)oint) to 12.4 niillinieters (a|)- 
proximately 48-point). The writer undertook to ascertain if 
there had been any further increase .since 1910. It; was 
impossible to use the same magazine as those u.sed by Starch 
(Scribner's and Harper’s) as the advertising sections had been 
cut from the magazines in binding for the university library. 
Co/her’s was sludied instead, with results as shown in 'J'able IJ. 

TABLE II 

Showing Average Height of Headlines in Full-page Advertisements 
IN Collier's for Years 1911-1920 Inclusive 


Year 

MM. 

1911 

13.40 

1912 

12.77 

1913 

12.25 

1914 

12.15 

1915 

13.31 

1916 

12.76 

1917 

13.20 

191B 

12.52 

1919 

13.67 

*1920 

13.57 

•First four months. 


If we accept the usage in this representative general maga¬ 
zine as indicative of the trend in advertising [iractise, we may 
conclude from these figures that there has been little change 
in the height of headlines in full-page advertisements during 
the past ten years—less than half a milJimeter between the 
height in 1911 and that in 1920. Moreover the average height 
for the decade i.s 12.9—but one-half millimeter gieatm- than 
that reported by Starch for the year 1910. From this we con¬ 
clude that Starch's statement, "the maximum size of display 
type for a magazine page has now been readied," is sub¬ 
stantially correct; and that on the average, 48-point type has 
proved of greatest effectiveness. 

III. The Use of Borders with Full-page Advertisements 

In an investigation of this problem Starch found (p, 83-4, 
Advertising) that the use of borders with full-page advertise¬ 
ments in *' standard magazines ’’ increased markedly from 1880 
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in 1910 The Dercentages of full-page advertisements having 
borders dnring the years 1880, 1890 1900, 1910 were 6. 38, 
82 and 11 respectively. Starch concliides, Ihei'c lias been a 
remarkable increase from the time vfhen large advertisements 
rarely had a border until to-day (1914) nearly every one has 
a border.” He opines that “the slight fluctuation for 1910 is 
probably an accidental fluctuation.” 

TABLE Ill 

Showing the Number of Full-Page Advertisemeots with Borders in 
Collier's Weekly from 1910 to 1920 


Year 

Full-Page 

Advs. 

Borders 

Per Cent 

1910 

284 

171 

60 

1911 

310 

1B8 

61 

1912 

235 

151 

53 

1913 

355 

199 

56 

1914 

336 

239 

71 

1915 

302 

203 

67 

1916 

465 

255 

55 

1917 

467 

232 

50 

1918 

413 

189 

45 

1919 

574 

217 

38 

*1920 

478 

168 

35 

*20 issues. 




i/Te._x.. 
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Ill ordci' to secure exact infonnatiou covering the jiracLise 
during the decade 1910-20, the writer conducted an investi¬ 
gation of the advertisements appearing in Collier's IVcckly, 
with results as shown in Table III and Figure 2. 
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These figures show that instead of a tendency toward in¬ 
creased use of borders with full-page advertisements, there is 
a tendency toward decreased use of same. Oui’ rosults indi¬ 
cate that the drop in Starch’s figures of 1910 was really sig¬ 
nificant; that the perceiitage is now hack where it wa.s in 1890. 
The tendency is shown graphically in Figure 3 based upon 
the data gathered by Starch, and brought down to date by the 
writer’s investigation. 

Whether the history of l>orders represents an evolution 
directed by the varying effectiveness of different methods under 
the conditions of the various eras, or wIicLlicr it represents 
merely changes in fashion is difficult to determine. Un¬ 
doubtedly there are fashions in advertising practise; particu¬ 
larly in matters that touch art-forms as closely as do borders, 
Fashions, we know, move in cj'cles. Hence, it may be that 
this curve represents merely the rounding out of a cycle 
which will later revolve in favor of borders again, What¬ 
ever is the true explanation, wc may confidently conclude that 
among progressive advertisers of to-day, the full-page adver¬ 
tisement without border seems to be most in favor. 


IV, Amount and Jiate vf Increase in the Use of Illustralions 

In the investigation of this question four mediums were 
examined—two weekly magazines: Collier’s and The Literary 
Digest; and two daily newspapers; The Indianafyolis Nc^ 2 vs, a 
typical metropolitan paper, and the Bloouiington (Ind.) World, 
a typical small-town sheet. Measurements were made at four- 
year intervals from the issues 1895-1919, (The years 1903 
and 1911 are missing in the case of the newspapers.) 

The results, as shown in Figure 4 enable us to state that 
the relative number of illustrations has tripled during the 
past twenty-five years. Whereas in the earlier period scarcely 
thirty advertisements in a hundred were illustrated, to-day 
7iiiicty in a hundred are so embellished. Though the small- 
size newspaper has not yet reached this percentage, both the 
magazines studied have done so, and the larger newspaper 
almost reache's it^ 

Using our conception of the "survival of the fittest” h 
advertising, we may well conclude that the use of illustra 
tions in advertising has paid. Our figures prc.sent a strlkiii} 
argument to the advocates of purely "argumentative” copy 
and suggest that the advertiser who wishes to profit by tin 
experience of the past will do well to use illustrations ir 
abundaiice. 
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WHITE, INDIAN AND NEGRO WORK CURVES 


By Thomas R, Garth, University of Texas 


The investigator -working in the field of racial i)sychology 
is looking either for similarities or differences, or perhaps for 
both. On the one hand he notes the statement of Tester V, 
Ward, who stood actively for the equalities, or similarities: 

"It is not therefore proved that inteUectual equality, which 
can be safely predicated of all classes in the white race, in 
the yellow race, or in the blade race, each takeii by itself, 
cannot also be predicated of all rac^s taken together, and 
it is still more clear that there is no race and no class of 
human beings who are incapable of assimilating the social 
achievement of mankind and of profitably employing the social 
heritage," Applied Sociology, Lester F. Ward, 1906, p. 110. 
And on the other hand he reads from Professor Giddings, who 
emphasizes the differences; 

"It is sometimes said that we ought not'to assert that the 
lower races have not the capacity for social evolution, because 
we do not know what they could do if they had opportunity. 
They have been in existence, however, much longer than the 
European races, and have accomplished imnicasuraidy less. 
We are, therefore, warranted in saying that they have not 
the same inherent abilities,” Rrmetp/w of Sociology, F. H. 
Giddings, 1896, p. 328, 

Woodworth's epoch making work in 1904 at the Louisiana 
Purchase Exposition {Science, 1910, No. 31, N. S.) tends 
to level the differences between races to almost a vanishing 
point in so far as more elementary processes are concerned. 
However, he said it was possible that the form board per¬ 
formances indicated differences of a racial character, but 
called this a mere ” crumb ” for the seeker of racial differ¬ 
ences, Bruner made experiments on the hearing of primi¬ 
tive peoples at the same time as Woodworth and in his 
conclusion to the monograph by the title "The Hearing of 
Primitive Peoples” {Archives of Psychology, No. 11, July, 
1908), says: "The one fact standing out most prominently 
as a result of these measurements is the clearly evident superi- 
ority of whites over all other races, both in the keenness and 
in the range of hearing sense. The evidence is so clear and 
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striking as to silence clleclually Ihc coiitcniion that the lieai- 
ing (unction, inasnuich as it is of rdaliveiy less milily in the 
Qiirsiiits altemling modern sneial ctiiiclilions than those suv- 
roiinditig the life of the savage, has fleterinvaKal and is de¬ 
generating. • . • Other ihiiigs heitig Vi[\\\i\ ihosu indi¬ 

viduals or races p(;ssessing ihe greatest cojn|ileNil.v aiul variety 
o( reactions to clenicnls in their resiieeiive eiivininiiuails like¬ 
wise will he gifted with keener aiui nmiv aeuH’ seiistjiy iiieehaii- 
isins," PI). 111-112. On the other hand In- says, un page 101 
ibid, " iHirtheiniiire, if we. compare this giamp oi iialive 
Indians with those who have lieeii in altnithmee ai the U. S. 
Governnicnt Schools,”—Imlh of these groups were included 
in the races compared wiili the wltiies—" it will he noted as 
striking that the more iiUelligenl Indians—thrise having heen 
subjected to the intliieiures of civilizaiitMi.have a la-Ucr audi¬ 

tory acuity than <h> those wlio have heen elnsesi to nature and 
a natural life. So far as ottr Ainerirrui Ittclians of iIk' plains 
are concerned, lherel«Me, it caiuio! he averred that their senses 
deteriorate with increased contact with civilization.” We are 
inclined to conclude from this tlial tlu; ililVerenees lure ineii- 
tioiicd among the Indians arc in [raining and not .so much 
in innate differences. 

Likewise some oi die mi»re recent iiua-siigators in race 
psychology place the eiii[ihjisis on lin* flili’ennces, Mayo ami 
Ferguson working on the Negr<i arc indim-fl to Ijelictv the 
differences hi-tweeii Whites and Xegrues are ladier large 
as Lised on Iheir investigations (.'irc/iii'iw u/ /*.sv., No, 28, 
1913, Mayo; /l)r/u'i‘e\v of I’syth.. Xo. ,16. 1916. I'erguson). 
while r3')e claims ihal liis results show specilic diilircnci's 
between the same races (.SV/imd nmi Sorii-ty. Xo\. I, 191.S, p. 
360), In 1917 Miss Simne tesli'«l Xegrn ami while childrini 
in New Orleans with the Hiiiel-Sinuin Scale ami Vci kes’ I'niiU 
Scale, i'lie conclu.sion re.iched hy iliis invesiigaioi is that 
variations in imlividnal rapacities i- pruhahly a-, ;;real an 
influence in causitig <litYcrciu:cs as ciiher race nr si x iJoiir. 
of Aff. No. 1. 1917. p. 8.V i IvtiWf lesu-d W hile ami 
Indian children aiul found railu-r ilecided dilT'H ik i-> as indi¬ 
cated hv tlu; I'dnet-.Siinoii Scale, (/'iv/. .Vi’iu., Ni>. 21. I'd l, 

p, 456.) 

The present writer in an article “ Nacial I Hti'i ri-nces in 
Menial Initignc ” {Jfui. nf .•If'f'liiil I'sw, lune, |o2()), calls 
attention to certain appamu *liMer«'iuT< iu wml; eiiive-. i.c., 
the tendency (m- Indians in t.all aw.av. nr “ la!icne.'’ Ic''’ ilian 
the while or negro groups who wmkiil ai iln- -aine ia''l< 
coiitiuuimsly, i.e., work in siuiplr aildiiinu I'lii- v . a - mie I'n- 
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the groups of younger and older children of the races com¬ 
pared in the two categories of attempts and accnmtcs. 

Popular opinion holds to the side of great racial dilTerences. 
Sometimes this persuasion is so extreme that it is called, in 
those cases, race prejudice. In some circles race prejudice is 
looked upon as innate, but it is more likely that it is a tra¬ 
dition with a rather long line of descent having once had a 
great eugenic value for keeping pure a racial stock. However, 
it would be well for the popular mind to take caution for 
we do not know but that experimental psychology may event- 
rially render the term " inferior races ” as innocuous as it 
seems it has the long honored term "the weaker vessel" as 
used in connection with sex differences. 

The elements in a study of racial mental similarities or 
differences must be these: (1) Two socallcd races R, and 
Rj, (2) an equal amount of educational opportunity, E. which 
should include social pressure and racial patterns of thought, 
and (3) psychological tests, D, within the grasp of both racial 
groups. We should have as a result of our experiment 
E D equal to, greater than, or less than Ro E D. In this ex¬ 
periment the only unknown elements should he R, and li... If 
E could be made equal the experiment could be worked- 

This element of educational opportunity-nurture, is the one 
causing most of the trouble in racial psychology as an uncon¬ 
trollable element, It does not offer quite so much difficulty 
in the study of sex differences, yet it is there only in suialler 
degree than in racial differencs, and as it is controlled the 
" sex differences" tend to disappear. Since this element of 
education, or nurture, cannot be eliminated it would be safer 
to take for comparison such racial groups as have had as 
nearly the same educational opportunity as is possible having 
any disparity of this sort well in mind when we interpret the 
results of the experiment. Having done this, we first take 
the complete distributions on the scale of measurement for 
the groups as statements of the true facts of the case, race 
for race. We then combine these distributions into a total 
distribution of accomplishment of all the races taken together 
to see if we have multimodal effects. Should we find these 
effects we may conclude that we have evidence of types, or 
racial types, and there should in this case be one mode for 
each racial group, But should the combined distribution for 
the several racial groups reveal only one mode we may con¬ 
clude that the test reveals no types—^no real racial differences 
blit rather similarities, (See Thorndike, Educational Psy., 
Vol. Ill, p. 322. p. M-7. 
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We may then further examine the distributed data for over¬ 
lapping in Hie several groups and measure that, using one 
group distribution as a basis for the comparison. 

This is what we have endeavored to do with the wofk> 
curves of Whites, Indians, and Negroes. The work curves are 
not given here, but will be found in the article hy tlu; writer 
referred to above. 

The question is this: Arc there separale and typical work 
curves for Whiles, for Indians, and for Negroes? 

Under the title "Work Curves," Jouriuil of Udiicaliaua! 
Psychology, May-Juiie. I9iy. the writer showed that for White 
children, one type of work curves exists for a siiecilicd sort 
of work (single column addiiioii) hir certain age group.s, 
under certain conditions. The same nietho<l of handling the 
data is cmiiloyed here. 

Third and Euurth Giatk SubjetlR—Atlempled {\rforiiiaiicc. 

TAHLI-: 1 

Per Cent or Work Doni*: in I'iw-St Six Minutes 


Per Cent 

W. 

Ind. 

Ncg. 

T, 

1-5 

i 



1 

r>-i() 

3 

i 

0 

•1 

11-15 

IH 

6 

5 

2!) 


no 

35 

1? 

171 

■Jl-l?r) 

IKl 

43 

58 

m 


37 

7 

17 

61 

:ii-:iri 

7 

0 

1 

8 

30-10 

0 

0 

1 

1 

•u-in 

0 




•10-.5U 

0 




r)i-.55 

1 




5()-no 

0 




61-05 

0 




66-70 

U 




71-75 

0 




76-HO 

1 



1 

Total 

3r>H 


tin 

551 


TAHLE II 


Per Cent Done in First M Minutes 


Per. Cent 

W. 

I ml. 

Nr.e. 

T. 

16-20 

1 



1 

21-25 

0 




20-30 

1 



1 

31-35 

3 

0 

T 

■1 

36-10 

!1 

3 

;; 

M 

41-15 

37 

20 

i 

(■>1 

16 ! i0 

5i> 

30 

31) 

2 : 11 .) 

51-55 

21 

10 

30 

17C, 
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TABLE II —Cofitimied 


Per. Cent W. 
56-60 29 

61-65 a 

66-70 1 

71-75 0 

76-aO 1 

81-85 1 

86-90 0 

91-95 0 

96-10) 1 


Ind. Neg. T. 

7 13 49 

1 2 11 

113 
2 0 2 

1 2 
1 


' 'i 


Total 


368 92 99 559 


TABLE III 


Per Cent Done tn Last Six Minutes 


Per Cent 


Ind. 

Neg. 

T. 

0 

3 

0 

0 

3 

1- 5 


0 

1 

1 

6-10 

"i 

1 

2 

4 

11-15 

24 

4 

6 

34 

16-20 

114 

28 

44 

184 

21-25 

196 

48 

43 

287 

26-30 

22 

10 

3 

35 

31-35 

6 

2 

0 

8 

36-40 

2 

1 

0 

3 

Total 

368 

92 

99 

559 


TABLE IV 

3rd and 4tK Grade—Accurate Performance. 


Per Cent Done in First Six Minutes 


Per Cent 

W. 

Ind, 

Neg. 

T, 

0 

27 

5 

0 

32 

1- 5 

1 

0 

1 

2 

6-10 

14 

1 

2 

17 

11-15 

29 

11 

10 

50 

16-20 

86 

30 

18 

134 

21-25 

95 

27 

24 

146 

26-30 

59 

7 

27 

93 

31-35 

23 

5 

6 

34 

36-40 

10 

3 

4 

17 

41-45 

4 

1 

2 

7 

46-50 

10 

1 

2 

13 

51-55 

2 

0 

0 

2 

56-60 

1 

0 

2 

3 

61-65 

0 

0 



66-70 

4 

0 

i 

' '5 

71-75 

0 




76-80 

0 




81-85 

0 




86-90 

0 




91-95 

0 




96-100 

3 

i 


’ '4 

Total 

368 

92 

99 

559 


559 
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TABLE V 

Per Cent Done in First Fourteen Minutes 


Per Cent. 

W. 

Ind. 

Neg. 

T. 

0 

7 

2 

0 

9 

1- 5 

0 

0 

0 


C-10 

0 

0 

0 


11-15 

0 

0 

0 


16-20 

4 

0 

0 

' i 

21-25 

3 

0 

1 

4 

2r>-30 

5 

1 

0 

6 

31-35 

10 

1 

2 

13 

aG-'lO 

19 

7 

4 

30 

41-15 

44 

15 

11 

70 

46-50 

81 

26 

27 

134 

51-55 

72 

20 

17 

109 

56-60 

46 

11 

20 

77 

61-65 

24 

3 

7 

34 

6(^70 

24 

1 

5 

30 

71-75 

7 

3 

2 

12 

76-80 

6 

0 

0 

6 

81-85 

2 

0 

1 

3 

86-90 

1 

0 

0 

1 

91-95 

1 

0 

1 

2 

9&-100 

12 

2 

1 

15 

Total 

368 

92 

99 

559 


TABLE VI 


Per Cent Done in Last Six Minutes 


Per Cent 

W. 

Ind. 

Neg. 

T. 

0 

37 

8 

4 

49 

1- 5 

3 

6 

2 

5 

6-10 

29 

5 

5 

39 

11-15 

52 

12 

19 

83 

16-20 

89 

17 

29 

135 

21-25 

80 

30 

-23 

133 

26-30 

47 

11 

13 

71 

31-35 

18 

4 

3 

25 

36-40 

4 

2 

1 

7 

41-45 

2 

2 


4 

46-50 

1 

1 


2 

51-55 

2 



2 

56-60 

3 



3 

61-65 

0 



0 

66-70 

1 



1 

Total 

368 

92 

99 

559 
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7th and 8 th Grade Subjects—AttempLed Performance. 

TABLE VII 


Per Cent Done in First Six Minutes 


Per Cent 

W 

Ind. 

Neg. 

T. 

1- 5 




L 

6-10 

’ie 

'2 

2 

20 

11-15 


75 

16 

319 

16-20 

97 

19 

14 

130 

21-25 

2 

1 

2 

5 

Total 

343 

98 

34 

475 


TABLE VllI 

Per Cent Done in First Twenty-Two Minute! 


Per Cent 

■w. 

Ind. 

Meg. 

T. 

32-36 

4 

1 


5 

37-41 

3 



3 

42-^16 

18 

'6 

3 

27 

47-51 

99 

38 

9 

146 

52-56 

171 

43 

19 

233 

57-61 

39 

10 

2 

51 

62-66 

a 


1 

9 

67-71 

Q 




72-76 

1 



“i 

Total 

343 

98 

34 

475 


7th and 8 th Grade—Attempted. 

TABLE TX 

Per Cent Done in-Last Six Minutes 


Per Cent 

W. 

Ind. 

Neg. 

T. 

0 

1 



1 

1- 5 

1 



1 

6-10 

17 

'i 

■3 

21 

11-15 

232 

73 

21 

326 

16-20 

87 

22 

10 

119 

21-25 

2 

1 


3 

26-30 

1 

1 


2 

31-35 

2 



2 

Total 

343 

98 

34 

475 
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7th and 8tli Grade-Accurate Performance, 

TABLE X 

Per Cent Done in First Six Minutes 


Per Cent 

w. 

Ind. 

Ncg. 

T. 

0 

2 

1 


3 

1- 5 
6-10 

3 

37 

i4 

’i 

3 

52 

11-15 

170 

47 

10 

227 

16-20 

105 

25 

17 

147 

21-25 

26-30 

31-35 

36-40 

41-45 

46-50 

21 

1 

2 

1 

0 

1 

g 

2 

4 

1 

i 

34 

4 

2 

1 

1 

1 

Total 

343 

98 

34 

475 


7th and 8th Accurate Performance. 

TABLE XI 

Per Cent Done im First Twentv-Two Minutes 


Per Cent 

W. 

Ind. 

Neg. 

T. 

31-35 

3&-40 

"3 

1 

'i 

10 

1 

3 

15 

116 

41^5 

46-50 

11 

75 

3 

31 

51-55 

110 

49 

10 

169 

56-60 

61-66 

66-70 

71-75 

76-80 

81-05 

100 

26 

11 

1 

2 

1 

13 

1 

10 

1 

1 

1 

123 

28 

12 

2 

2 

1 

Q 

86-90 

3 



u 

Total 

343 

98 

34 

475 


TABLE XII 


Per Cent Done 

Per Cent 

W. 

0 

4 

1-5 

6 

6-10 

49 

11-15 

205 

16-20 

73 

21-25 

6 

26-30 


Total 

343 


IN Last Six Minutes 


Ind. 

Neg. 

2 

T. 

6 



6 


'7 

76 

44 

14 

263 

25 

11 

109 

5 


11 

4 


4 

98 

34 

475 
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TABLE XIII 


Third and Fourth Grade 

Attempts 


(a) First Six Minutes 

Whiles 

Indians 

Negroes 

Median..— 

% reaching median of whites 

21,61% 

22.08% 

54% 

23.46% 

78% 

({)) Firs/ Hoff of Total Time 

Whites 

Indians 

Negroes 

Median... . 

% reaching median of Whites 

50.28% 

49.88% 

43% 

51.89% 

65% 

(c) Last Six Minutes 

Whites 

Indians 

Negroes 

Median.... 

% reaching median of Whites 

21.59% 

22.69% 

68% 

20.13% 

37% 

TABLE XIV 



Third and Fourth Grade Accurates 


(o) First Six Minutes 

Whitte 

Indians 

Negroes 

Median... 

% reaching median of Whites 

22.41% 

20,95% 

42% 

24.00% 

68% 


(fr) First Half of Total Time 

Whites 

Median. 51,52% 

% Teaching median ol Whites 


(c) Last Six Minnies 


Whites 


Median.^. 19.82% 

% reaching median of Whites 


Indians 

50,25% 

u% 

Indians 

21-64% 

69% 


Negvoes 

52.75% 

55% 

Negroes 

19.28% 

48% 


TABLE XV 


Seventh and Eighth Ghadbs—Attempts 


(o) First Six Minutes 



Whites 

Indians 

Negroes 

Median. 

14.91% 

14.66% 

15.95% 

% reaching median of Whites 

46% 

64% 

(b) FirsI Twenty-two Minutes 


Whites 

Indians 

Negroes 

Median. 

53.02% 

52.33% 

53.56% 

% reaching median of Whites 

43% 

53% 

(c) Last Six Minutes 


Whites 

Indians 

Negroes 

Median. 

14.99% 

14.61% 

14.50% 

% reaching median of Whites 

46% 

44% 
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l AllLK XVI 


SliVl-NTIl .\Nn KIOIITH CWlAHl-.S- 

-Aaun.MKs 


(fl) First Six MhiuK^s 

Whiles 

Indians 

Negroes 

Median.. fi.-,-. 

% rcaclung iiii'dian ol \» 

lo iti’,;, 

la (A'v; 

•ihv; 

1(1 

7;v;, 

(6) First .Wnmfc.c 

Whites 

hulians 

Negox's 

Median.,., , - 

•;i reaching; median of W liilea 

a} ii’i'i 

a^.TOV;, 


(e) lost .ST'.r iUinii/es 

VViiih s 

Imijans 

Negroe.s 

Median.• 

% reacluni; median of \Sliiies 

M 10'; 

15 

\Vi' 

•M'T 


The younger groups \vi»rheil nuiiiUcs, ihc (ildcr 

grouj)s worked fnt(y-two iiml all niciii! groups worked 

under tlie saiin.' foiuliliriii'. 'rbi ii' wnr uvf» cnlegories—;it- 
lcnij)ts ;iinl iicciirales 

Since dislrilniliorjs ini' :i]| jitjiiil?* in tin- rurei- are out of 
the qiiesliou llu' eutvi‘> wrti' lappril in ihn-r places and lliree 
distrihiuioiis wior tn;nl«- ni lapping's-. il| A 

Inilioii of wliat llio hnlividnals oi a group did in tin- lir^l six 
miimles, (2) a •lisltiltuiinji of whal liad luen done hy dio 
lime about oiu* lialf of ili«‘ loiai w-oldni; perioil hail rlapsed. 
and (3) a ilisitihutioii of wliai i!i<- iiidividnals ilid in llic last 
six ininulcs, Tin' lahli''. im s! nt* il hm v.iili give the racial 
grouj) (lisiriliulioiis \\ Jndiati-. and Ni ipm-s si paraiely, 

and the lliree lanal gnuip:- i'«>iiilinn-d iiiln a toial in caeli in¬ 
stance. 

It will be seen dial vi-r v.r lap ilii- oual cni ve I made 

of the three racial gonijis of pi■n’oriiH'r'-) du- ilisii ilmiimi for 
same has a. siiigb' ni«>(b'. vvliedii > o tin- r.ise id rlisirilm- 
lion at the heginniui; oi iln- euive. ilu- middh of the evnve nr 
the end of il. Tlioiigh f.icli r.ii ial eutvi ha-, ii'i idiosyncrasies 
as found in that enivi- iisrlf this ilii^■-^•lle^a>v is Ill'll in the 
total (lislrilmtion. Ainl tin -r iilio-yncrasies liy llu present 
test of the data show no grem deparnnr fi'o]]] the coiiiiiinn 

curve. This single niodaluv Ini!.!- inr all the curves.younger 

and older groups in hoth atteinpi-- atid ai-curacy. and aliliougli 
the curves have heen iapiie<l ni milv tlirei places, ilu' I'egin- 
niiip, die middle, and liie rnd, the .i- .are verv vii.il ]ioiiii' and 
it is likely that tapping at nihe! pmni'- would o vt al the same 

-sillialion.a uni-moil.'il di-ti iliiitmn i in ve. In i iinsfriiimi c 

this handling of the data i-- )<ut .a lujipori of tlie claim that 
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none of these curves are racial in a typical sense but each con¬ 
tributes toward a common human work curve, and to that 
extent stands for similarities rather than differences, 

We now in the second place take the expanded data and 
examine it for overlapping using as a basis of comparison the 
medians of the White groups. 

Granting that these three groups really ])elong in one large 
croup, the question still remains: How docs one sub-group 
compare wi-th another? See Tables XIII, XIV, XV, and XVI. 
It will be seen that there are only three instances in which the 
overlapping of the White and Indian distributions is as much 
as 60% and above, whereas there are six cases of overlapping 
above that amount when the Whites and Negros arc com¬ 
pared, The most significant instance is where at the begin¬ 
ning 78% of the younger Negroes attained the median of the 
younger Whites in attempts. Only 37% of tliem attained 
the median of the Whites for attejnpts at the end, whereas 
68% of the Indians of the younger group attained this same 
White median at this point. In. fact, as we have shown else¬ 
where, the Indians make a good showing when compared with 
the Whites and Negroes with resxiect to the last six minutes 
of work in all instances excepting where only 46% of the 
older group attain the median of the Whites of the older group 
in the attempts category, for this part of the common curve, 
and the Negroes consistently fall below the median ijcrform- 
ance of the Whites and Indians during the last .six minutes 
of work, 

The figures representing what was done by the time al)OUt 
half of the period of the total working time had cla[)sed arc 
interesting. If one worlts absolutely at a regular rate he 
should, of course, have done 50% of his work ])y the lime 
half of his total working period was up. Ry running ovei’ the 
above mentioned tables (Tables XIII, XIV, XV, and XVI), 
one may observe that consistently more Indians were inclined 
to do less of their total work than the median White did, 
and that more Negroes were inclined to do more of their 
work than the median White by the fourteenth minute, for 
the younger workers, and the twenty-second minute for the 
older workers. This means then that slightly more than half 
of the Indians were even ts deliberate, ov more so. in their 
work as the median White, and that half of tlu; Negi-oes 
were inclined to be less deliberate than the median While— 
with one exception only: as in the accurates category of the 
older Negroes where they did just the .same part of 'llieir 
work as did the Whiles. 
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These measures of overlapping are significant as far as they 
go and are to be taken into very careful consideration before 
one takes a stand for a belief in racial work curves of Whites, 
Indians, and Negroes or in just a coiiiiiion linmon work curve. 
It is a fact that they incline one to see differences and we 
may add that mixture of blood in the Indians and in the 
Negroes may have prevented these differences from being 
more apparent. 



CONTROL OF CONDUCT BY SUGGESTION: AN 
experiment in AMERICANIZATION 


By Garry C, Myers, Cleveland School ol Education, Cleveland, Ohio 


When the course oi study and the texts* \vhich are now 
used in the Ainericaiuzatioii Schools of the Army were devel¬ 
oped at the First Recruit Educiitional Center at Camp Upton 
there was a conscious attempt to make as llic warp and woof 
of the lessons a propaganda for that school, for more edu¬ 
cation by the soldier and his home folks, for the Army, for 
the United States government, and for America and American 
ideals. It was assumed that all suggestions of proper habits 
and virtues are most effective when camouflaged and espe¬ 
cially when the learner unwittingly becomes a teacher of those 
duties and ideals which it is desired he shall get, The learner 
is not told that he should sleep with his windows open, that 
he should brush his teeth and clothes, stand erect, sit erect, 
take care of his appearance and respect the great men and 
flag of our country. Instead the learner liccoincs the reader 
or the writer of a letter’ to a friend in which he tells that he 
has developed these desirable traits, attitudes, and virtues and 
suggests indirectly or directly to this friend that the latter 
covdd do the same and attain the same virtues and attrihv\tcs. 
Throughout, the learner suggests the veiy virtues to himself 
which he seems to be suggesting to his friends, A few sample 
lessons follow: 

Co. D., Recruit Educational Center, 

Camp Upton, N. Y. 

December 7, 1920, 

Dear Mother: 

It is pretty cold some morning when we must jump out 
at^ Reveille but we must move so fast then that we do not 
mind it. A soldier does not feel the cold much because he 
sleeps with his windows open. When I came to the army I 
was sure I would take cold if I slept where the windows 
were open, but I soon learned that fresh air i.s tire be.st cure 
for a cold, I have never felt so well in all my life as I feel 

* Army Lessons in English by Capt. Garry C. MyCrs, War Depart¬ 
ment, 1920. 
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now. Almost every soldier says the same. The army is the 
place to be. I wish Zebediah would join the army, Then 
he would learn to clean his teeth, to stand erect, sit erect and 
walk erect, and to keep his elbows out of his pockets, 

If you sec Nellie tell her I still like cake, 

JcrcMniah I’uth'r. 

From the next lesson is the. followiiijj; 

"You know that Theodore Koosevcll had four hoys, an<l 
they were all soldiers. (Jiie boy, who.se name was Quentin, 
gave up his life for his country in the Great War, We honor 
his memory and we honor the memory of hi.s father. Kvery 
good American is ready h) do the same as Quentin Roosevelt 
did. A loiifg time ago, when our country was fighting for 
freedom a great American soldier by the name of Nathan 
Flale said as his last words, ' I only regret that 1 have luiL 
one life to give for my country.’ Don't you iliink that was 
wonderful ?” 

Moreover, lltose first lessons of the course leading u() to 
letter-writing aim to " sell ’’ the course and tlie school to tlie 
learner; to suggest to him that he wants to learn and wliy 
he wants to learn. The first sentence he reads is " I want 
to learn English" and the fifth is “I want to learn to write 
a letter home." In his eighth lesson he reads as a saniiile 
a first leller to his .s\vcethe;iit: 

Co. 11, Recruit Educational Center, 
Camp Upton. N, Y. 

January 8, 1920. 

Dear Nellie: 

I got your letter and the sergeant read it for me. I'he next 
letter I am going to read my.sclf for I am learning to road 
and w'rile Engli.sh. I am writing this loiter iny.self. It is my 
first letter. I liope you like it. I like the army very well. 
I want you to see me drill. 1 can drill very well. We drill 
every day. 

Jim Jone.s. 

In hi.s next lesson, which is a letter to his mother, he reads: 

Co. C. Recruit Educational Center, 
Camp Uplon, N. Y, 

February 1. 1920. 

My dear Mother; 

This is my first Idler home. I am going to w'rilc yon a 
lettei’ every week. I got a long Idler from Nellie. Slu* 
said she saw you. The sergeant read it for me hut her next 
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letter I am going to read myself. I want to ruiul a good book, 
It is a hard job to learn to re.'id and write but a gofid soldier 
likes a hard job. I Iiave a good caiJlain. He is a friend lo 
every soldier. 

Robert Brown. 


In these letters he suggests to himself, that lie i.s going to 
read the next letter from his sweetheart, that he is going 
to read a good book, that he is doing well, a l)ig job and that 
hia captain is his friend. In succeeding lessons lie reads and 
writes from sample letters the following suggc.stioii.s: 

"Every good soldier knows how to handle a gun.” 

"I am sorry that I did not go to school at home, I did 
not think then that I could learn, hut I am sure now that I 
can learn. I can write letters to Nellie and 1 can read her 
letters to me.” 

"I have read a few letters hy Theodore Roosevelt to his 
boys and I want to learn to read some speeches liy Woodrow 
Wilson, President of the United States.” 

In the third grade, his second lesson is a letter to Nellie 
from which he reads: 

"I have learned to brush iny teeth, lo keep niy head and 
shoulders up, and to keep my itnifonn neat and clean. I wish 
I could get my teeth to look as clean and as pretty as your 
teeth,” 

It should he remembered that these arc not mere state¬ 
ments but personal expressions to one, Nellie. The dramatiza¬ 
tion tarries over very well, so well that the average soldier 
enthusiastically plays the part in "writing” tlicsc letters, 

The non-English soldier who reads the following from a 
letter to ” Dear Bozo ” speaks with pride: 

” When wc go to New York wc can see men and women 
coming into a new land just as we came five years ago, and 
we know how they feel. Of course, wc want them to like 
America as we like America. Wc want them to know that 
the cleanest, best and most Useful American is the soldier. 
Therefore when I go to New York I want to look my best." 

Careful records have been gathered which indicate that 
the men take over these letters by phrases, sentences and often 
in their entirety, when they write home. Most of these men 
have limited mental content; so they are glad to grasp at 
almost any word, phrase or sentence suggested. Undoubtedly 
they write home much which they at first did not 1)elicvc and 
over which they were not always enthusiastic. Furthermore, 
those at home, because they look upon these soldier.s, their 
near friends, with esteem, catch up the suggestions. 
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As good evidence that the lessons read by the soldier tended 
to express themselves in what that soldier actually did write 
home there are given below copies of several letters or excerpts 
from them, It should be noted that practically every senti¬ 
ment expressed in these examples had a[)|)eared once or sev¬ 
eral times in the lesson-letters of the reading texts. 

vS'oinc Actual Letters-Hvinc 

" Dear Motlier: 

Yesterday I received the socks which you sent me. I can 
write letters now as you see. I am sure you will find me 
looking better then when I left. I am a better man I look 
much better and feel much better then I did licforc I enlisted 
in the army and I know much more. I am for the army.” 

" I always Icecp my clothes clean and have to keep my teeth 
clean. I have to brush my teeth. I received the socks that 
you sent me,” 

Dear Sister Ethel 

I have ben in the army now about three monts an when 
I first came in the armey I Didcnt rely know what our flag 
ment. But it means much more than red whit an blue cloth 
Every stich an every thread mcairs many American .soldiers 
'wlio suffered died an bled. For thcar country an thear coun¬ 
try is our country an I am proud to be a soldier They did 
not suffer an die for thcinsclfs but for thcar country for their 
farther mother an brothers sisters an sweethart. An I have 
sure learned to lionor our flag it means more than you could 
think Tell brother I wish he would join the Army.”* 

Dear Mother. 

I have not heard from you lor long time, I hope you are 
not ill, I have been in the American army three months and 
I lilcc it very well. When I came in the army I could not 
read or write English, but now I can read and write a little 
it has been three years that time when I cane in this country 
and am in school now to want learn good English ” 

Dear Mother 

I am in scliool today I like to go to school We go to school 
every morning and every evening. I would like to see you. 
I may lie home before long on furlough. I feel much better 
since I joined the army. I like the army fine. We liavc 

• Foot-Notic.—T ills is a faithful reproduction in itaiaplu-ase of n. 
lesson-lcUer on ihe American flag. 
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plenty of good clotliea to wear, we go to tlie moving picture 
show every night. We have plenty of good l)aoks to read 
and we have a good time." 

"dear mother yesterday from a walk i learned to write letters 
I am go to write every week I am a soldier I am go to read 
a book from abraham lincoln as 1 will clo.se " 

"I am. this army. 6 months and this camp. Upton i learn, 
som. end, go to scoold. every, day. learned reath and. write- 
now. he can write letter myself home, before and. go to 
my sergent read my letter, now i can. read, myself. I write 
letter and read were well." 

"My dear Mother. 

This is my frist letter to you. 1 am surprise you that I 
am writing, to let you now that I am Well. I hope your 
our Sampn. Mother I have A good Captain he i.s a friend to 
every Soldier, I go to School every day and I now how to 
read, and writer, our. Captain learn, os how to handle A gun. 
and we like to drill, every Soldier likes to handle a gun. 
good luck,” 

"I am for the Army because oncle Saui dew hi.s liest for 
me I like you see me now I wight 150 lbs. my Capt said I 
contined aet so much I wight 200 lbs the Co. 13, his the best 
Co in the Camp Upton I got a very good Capt,” 

" My dear Mother. 

this is my frost letter I write you, and I hope to see you 
soon, dear Mother I am filled much better now and much 
strong I am sure you will find me looking better tlicMi when 
I left home. 

Dear Mother I like the army very will \vc have plenty eat 
and good clothes” 

“ before I Came to the army I could not write my name every 
menth I get a good money I have good clothes plenty to eat 
I do not pay for them ” 

Another avenue of control of conduct of the illiterate soldier 
at Camp Upton was in the public speaking course. The soldier 
in this class presumably was getting training to help him 
qualify for recruiting duty. This very purpose suggested 
to him that he must make speeches magnifying the virtues of 
the school and of the army. He proceeded therefore in im¬ 
promptu speeches to tell of what the school had clone for 
him. Consequently there developed a strong rivalry among 
the members of this class (public speaking being voluntary) 
to make the most embeUished speech about tlie very things 
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which were suggested ii^ the lesson letters. Sojne who had 
scarcely begun to read and write extended their imagination 
so as to tell, as if it were true, of how well they had learned 
to read ajid write English since coming to that school. By 
suggesting to a number of the old time " chronic-ldckers ” 
of the Camp that they would make good .si)cakci's, many 
of them became strong competitors for first i)lac(; among the 
boosters of the .school, tlieir company, the camp and the army. 
They kept at this h(;o.stijig for .several cla.s.s periods until 
they really hcgaii to helieve what they were -saying and to 
act accordingly. Thus l)y their own suggestions they became 
effectUcil jni.ssionaries for morale. 

Little doubt i,s there that in education one of the most 
effectual means for controlling conduct is by suggestion, 



EDUCATIONAL GUIDANCE AND TESTS IN 
COLLEGE* 


By Stephen S, Colvin, Direclor of Ihe Scliool of Ediicalion, Brown 
Universtly, Providence, Rhode Island 


At the beginning of the academic year 10L9-20 Brown Uni¬ 
versity inaugurated a system of educational advice and direc¬ 
tion for its students, the details of which are still in the mak¬ 
ing, The most essential features so far put into operation 
are the following: 

(1) On the first day of the college year the first-year men 
are given the Thorndike Mental Test for College Frcslinicn. 

(2) A 'few weeks later these men are given the so-called 
Brown Psychological Test. The Brown University Test is 
composed of two parts; the first requiring twenty-five niiiiiites 
for administration and the second, thirty niiiuitcs. Separate 
elements of the test are: completion, vocahulary» opposites, 
mixed relations, facts-and-conclusions, and arithmetic. This 
test requires about a third of the tinw of the Thorndike Test, 
but shows results almost identical, correlating with llie Tliorn- 
dike Test by a Pearson coefficient arovmd .IX) and frecprently 
showing a closer agreement with llie Tlioriiclike Test than do 
separate parts of the Thorndike Test itself. 'l"he reason for 
giving both tests ia to check up Ihe occasional contradictory 
results that are found and to discover their causes. 

(3) Early in the year each new man h rc([uirod to fill out 
a personnel card which through a series of questioiis seeks 
to discover: 

(a) The purpose the student has in coming to college. 

(b) His academic interests while in high school. 

(c) His activities in various sports and out-door life. 

(d) His reading interests. 

(e) His vocational aptitudes and interests. 

In addition to answering questions concerning the.se mailers 
the student is required to give an estimate of himself in 
regard to twenty-five qualities relating to intelligence, hal)its 
of study, character, temperament, so cial intere.sts and healih. 

♦This paper was read at Atlantic City, Feb. 25, 11)21, hcforc die 
National Vocational Guidance Association. 
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(4) Later in tlie year each student is interviewed by a 
mciiiljcr of the Cojjiniitttc on Educational Advice and Direc¬ 
tion, wlio after consuUalion with the student fills out a second 
personnel card, wJiicli is filed with the card previously made 
out by tlie student. On this second card are recorded the 
scores /luicle in the [isychoto^ical tests and all academic grades 
that tlie student may have received, in addition to otiier items 
of interest such as whether the student entered on condition, 
whether he has received any academic honors, whether he 
has been warned for poor work or is on probation, Also 
there is added any information the student may be able to 
give concerning his secondary school career; the academic and 
vocational interest's and plans that he may have; his habits 
of sliuly, with particular reference to the place, time, technique 
and amount of sUtdy; his outside interests and distractions, 
including work for sedf-support, extra-curricula college activi¬ 
ties, and amusemeuLs and recreations. 

In additinu, from the intervdew with the student, his advisor 
discovers and recctrds the following facts, as far as possible: 
(a) the birth [)iace of the student and of his parents; (b) 
the nuniher of children in the family and the order of birth 
of the student; (c) the occupation of the father and his ap¬ 
proximate income; (d) the occui^ation and schooling of broth¬ 
ers and sisters with [)ai'ticular reference to the grade that they 
lla^'e completed in .‘;ch()ol and their age at the time of finishing 
this gi-iule; (c) the age at which the student graduated from 
lugli .school together with ajiy other information concerning 
his .sclinol career. 

(5) Early in the year a blank is .sent to the principal of 
the school in which the student prepared for college, asking 
information on the following jioiiits: (a) the rank of the 
student in his class, with the number of members in the 
class; (i)) the cour.ses in which the student did his best and 
his poorest work; (c) the extra-curricula activities of the stu¬ 
dent; (d) his interesLs; (c) his qualities of initiative and 
leadership. In addition, the principal is asked to give an esti¬ 
mate in regard to (puilities of intelligence, character and social 
adaptabilities jiossessed hy the student. 

(6) During the first half of the freshman year the stu¬ 
dents arc leijuii'cd to attend a conr.se of orientation lectures 
given hy various administrative oflicers and instructors, These 
lectnrc.s are de.signed lo inrurni the student conceming ijiipor- 
tant details of college life, ideals and methods of study, hygiene 
and [K'isonal habits, and the aims and coiilcnt of general fields 
of knowhrdge rii[n'esented in the curriculum, 
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(7) The students are again interviewed l)y tlieir advisors 
at the end of their sophomore and junior years. At the end 
of the sophomore year each student is vetiuircd, under direc¬ 
tion, to select certain courses and grou|is of studies in teru\s 
of a definite scholarly interest or a life career. 'J'liese studies 
are to satisfy the requirement for concentration, not, how¬ 
ever, in terms of departments of knowledge (as was pre¬ 
viously the case) but in terms of interests and apliiudcH. 

(8) In addition to these regular interviews, sludciits arc 
required to consult with the chairman of the Coinmillec wIilmi- 
ever particulai- reasons for such consultation arise, such as 
poor or uimsually excellent college work, on dis|uirity lielween 
psychological scores and college records. One particular 
function of the Committee is to stimulate students of high 
ability and attainment to do work worthy of their capacities. 
For this reason, the direction of reading for final honors, open 
only to students of unusual intelligence and academic achieve¬ 
ments, is in the hands of the Committee. 

(9) Finally all students in the University are urged to con¬ 
sult with the Chairman of the Committee during his general 
office hours in regard to any problems connected with their 
college work or their life careers which may he iinportant 
for them, 

It will be seen from this account that psychological tests 
play by no means the entire part in the work of guiding the 
student, They, however, are extremely iiseful in various ways 
and are frequently of great service in clearing up doubtful 
points in regard to the students’ abilities, aptitudes and achieve¬ 
ments, They have been found particularly valuable in the 
following ways; 

1, They throw some light on the question as to whether a 
student is better suited for a professional career or for busi¬ 
ness pursuits. They cannot do this, however, in any l)vU a 
most general manner since the range of intelligence among 
college men is narrow and since practically all who remain 
for any length of time in college receive scores that i)lace 
them somewhere in the professional occupational intelligence 
group as determined by the army intelligence ratings. Brown 
men obtain a median intelligence score that is somewhat higher 
than that of civil engineers and medical officers ami some¬ 
what lower than that of army chaplains and engineering offi¬ 
cers. Occasionally a student receives a score tliat would place 
him on the occupational level of clerical and semi-professional 
workers, but never so low as that of the skilled laborer, At 
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present tlie jfenernl pracUce of the advisors is to urge inen of 
high intelligence ratings to enter some one of the professions, 
provided that in addition their character, interests and special 
capacities seem to qualify them for such a life career. This 
practice i.s based not only on the consideration of the abilities 
of the students hut also on the needs of society. It is found 
that very few young men, even those of high ability and char¬ 
acter, are planning on careers in medicine, law, teaching and 
the ministry. On the other hand, the large majority of stu¬ 
dents, as far a.s they have formed any definite purposes, are 
thinking of l)usiness, though in a rather hazy fashion. 

2- The lests indicate to an extent the tyjjc of mind that a 
student po.ssesses. I'or example,—a student who does much 
better in his college work than on his mental tests may he a 
slow but rather accurate thinker who learns less readily than 
some of his fellow students but who retains and assimilates 
what he once masters. There is some evidence to show that 
psychological examinations of the type of the Thorndike and 
Brown tests are unfair to men who are plodders but careful 
and accurate thinkers, Here is a specific case in point. 

A student of the present junior class who appears to be 
a man of at least average ability and of more than average 
earnc.stness of purpose received a score in his psychological 
te.Us that indicated him to he of unsuitable intelligence to 
succeed in college work. His college grades, however, have 
been above the average. When questioned about his psycho¬ 
logical tests he said that they took him by surprise and that 
the time limits bothered him. He finds that he can respond 
rapidly to something that he has memorized, hut cannot think 
under pressure. The student was later retested with an al¬ 
ternative mental examination in which no time limit was fixed 
for the various sub-tests. The result was that he raised his 
score by thirteen points, confirming the diagnosis that he 
was of about median college intelligence and that he owed his 
success largely to careful and regular habits of study rather 
than to brilliancy or rapidity of thinking. 

3, Intelligence tests make possible a distinction between char¬ 
acter qualities and mental alertnes.s. It is evident from the 
examination of Brown students that intelligence considered by 
itself is by no means a perfect measure of success or failure 
in college. Of cour.se, intelligence is undoubtedly positively 
correlated with character, and an intelligence rating is never 
a rating for pure mental ability alone, but is also to a degree 
an jjKlex of volitiojial and'othcj- character qualities. But fur¬ 
ther than this, numerous cases have been discovered in which 
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the disagreement between intelligence scores and college grades 
is clearly due to qualities of character and temperament. Gen¬ 
erally the disagreement is evideuced by students who receive 
high intelligence ratings and low college grades; sometimes 
the reverse is true. Examples follow: 

A member of the present sophomore class scored high in 
all his mental examinations. He graduated from higii school 
at the age of seventeen, standing in the upper tenth of bis 
class. His college record, hovrever, has been disappointing. 
He confesses that he is laay in his mental habits and lacks 
determination and ambition to study. 

In contrast to this student is another member of the same 
class, who is clearly somewhat below the average in intelli¬ 
gence bat who is determined to succeed in his work and who 
is making good grades because of his will-to-do. 

Some students succeed or fail in college because of emo¬ 
tional qualities, As an illustration of this fact the following 
case is in point: A member of the present sophomore class 
obtained a high rating in-the Thorndike Test and an average 
rating in the Brown Test, the lower rating in the latter test 
being due probably to physical disability while taking this 
test—the student having fainted a short time before, some¬ 
thing that he says occurs quite frequently. He graduated from 
high school at nineteen, having been out of school two years 
because of ill health. He has two sisters and one brother, 
all of whom are at least one year in advance of their normal 
school grade, There seems to be little doubt that the stu¬ 
dent's intelligence is above the average; his work in college, 
however, has so far been almost a complete failure. He is 
now on final probation and has a record of six E’.s (failures) 
out of a total of fifteen courses taken. He say.s that he is 
extremely nervous and that he cannot endure the strain of 
the ordinary college examinations. He got on well in high 
school because of the fact that his grades were .so high that 
he was not obliged to take formal tests to pass his courses. 
In the formal college tests he “gets chills and is all-gone." 

4. At times tests throw light on the home environment and 
educational equipment of the student. Sometimes students 
who score relatively low in their psydaological tests do so be¬ 
cause of the fact that they hear a foreign language spoken at 
home and for the most part think in a foreign language. This 
is particularly true of a group of Italian students now at 
Brown, Their college work is markedly better than what 
seems probable from the prognosis made on the basis of their 
menial scores. 
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In tills connection it may be interesting to note that in a 
recent comparison of the results oJ mental tests given pupils 
in one grade in a Providence school the results of the Terman 
revision of the Hinet Tests were found in general to agree 
rather closely with the results of the National Intelligence 
Tests as far as American children were concerned, In the 
case of children of Italian parentage, however, the mental 
ages were from one to three years lower in the National Tests 
than in the Teriman Tests. The tentative conclusion is that 
the National Tests, largely linguistic in their nature, failed to 
reveal the real iiUelligeiice of ihc Italian children because 
of their unlavoruhle home environment as far as the speak¬ 
ing and reading of English is concerned. 

5. Tests somelinie.'i reveal the presence or lack of scholarly 
ambitions and i)ro])cr education ideals. Students often take 
the attitude of treating their college work as a task to be 
perfornicd raliicr than an opportunity for improvement. This 
is not true merely of those who are content to work only just 
enough to “get by/' hut this point of view is all too frequently 
found among men of high ability wlio can get really good 
grades oji an amount of study often averaging not more than 
six hours a week, It is very clear that our higher institutions 
of learning, iii common with our lower sch6ols, are jiot chal¬ 
lenging the abilities of their best students. 

6. Tests often show whcllier it is desiralile for a student to 
continue in college or to withdraw. Intelligence tests have 
not as yet lieen used at Brown to determine college entrance, 
except in a few exceptional cases. They frequently indicate, 
however, whether it is worth while to keep a man in college 
or not. If a student has an extremely low intelligence score, 
and if his grades arc markedly below average, there is little 
use in keeping him on semester after semester. It is equally 
true that a student of ability who constantly fails is undesir¬ 
able college material because of his lack of character and 
ideals. 

7. The results of the tests frequently serve as incentive to 
students to do work up to the level of their mental abilities. 
It is the writer's practice to show to a student who is doing 
college work distinctly below his real ability his case in a 
graphic form. For this purpose a wall chart is made which 
indicates each student's position in tlie psychological ratings 
and also in his academic achievement. It evidently produces 
some imincssion on a man to say to him,—“Here you stand 
in the first third of your class in your psychological scores, 
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and yet you are here (hventy ])oints lower) in your college 
rating. You are not IWing up to your possibilities. You 
know the facts; now it is up to you.” I am confident that 
such an objective presentation carries vastly more weight than 
any good advice could possibly bring to l)ear, Facts are more 
impressive than general statements and sometimes ])roduce 
results which no amount of exhortation could accomplisli. 
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It is merely stuiiuK obvious lo say that profound scholar¬ 
ship is not even iircsuinpiive evidence of teacliing [jower. The 
converse is equally true, that teaching; power dues not neces¬ 
sarily betoUen ^^reat scholarslnp, Our colleges have great 
teachers whose sclioIai‘shi|) is mediocre and both colleges and 
schools have suffered from men of deep, broad and sound 
scholarship whose teaching was and is a travesty on their high 
profession. 

In training teachers, persons arc discovered who develop 
an Intellectual acumen out of all proportion to their social 
and volitional power. Tlie-se persons come to the end of their 
course with high ratings for scholarship, with a thorough and 
broad knowledge of professional technique, but when they 
attempt the tcacln'ng process they fail utterly to pj’oject either 
themselves or tltcir subject into the class before them, We 
say of them that they are immature, that they lack social 
experience, that tlwy lack personality. This Judgnient is 
tempered by our knowledge of numerous cases or a like sort, 
where greater maturity, wider contact with life, have developed 
a dynamic personality. And for this reason we arc properly 
cautious in our judgment of all minus or merely colorless 
personalities among teacher recruits. We hesitate to declare 
that any specified person will never develop this teaching 
power; but in this hesitation lies the source of the continual 
stream of poor teachers, teaclicr failures, the derelicts of the 
profession. 

This personal power is the unknown quantity in higher 
education but particularly in teacher training. The school 
of education addrcsse.s itself to the task of developing scholar¬ 
ship and to tJie inculcation of special methods iji a restj-icted 
field. The college entrance requirements are defined wholly 
in terms of scholarship, the test being a test of the intellect, 
and that largely a test of retentive memory, That memory 
is a very small clement in teaching power has not disturbed 
our equanimity; that intellect is only a fraction of the teach¬ 
er's dynamics, has not affected our plans. We have made 
the humhlc confession that personality is a vague term, diffi- 

39 



40 


BRUBACHER 


cult of definition, a complex resultant of heredity, of environ¬ 
ment, experience and training, and this humility covers a host 
of pcoEessional sins. 

We have made no consistent effort to analyze the teaching 
personality, either for the purpose of eliminating from the 
ranks of teachers in training, those who have it not; nor yet 
dor the purpose of developing and increasing and ituproving 
those phases of personality which are present at the outset in 
a small degree. 

The intelligence test, so called, is the first hopeful sign 
that there is a way out. It gives promise that there is a 
means of testing personal power, of discovering personal 
qualities which rest in the cuiotious and the will either in 
whole or in part. And tests of the motives which lie behind 
human behavior, if they can be made, will shed bright light 
on personality and will bring Into high relief the elements 
which are the bases of the teaching personality in particular. 

The "intelligence quotient” is, true to its jiamc, prlmai’ily 
a test of the intellect. Its superiority to the conventional edu¬ 
cation^ tests lies in the fact that it tests not only memory, 
but the power of perception, the association of ideas, reason, 
the power of judgment, comprehension, ingenuity, etc. Tliat 
is, while the conventional examination may call for any or all 
of the intellectual qualities enumerated, it is clirficult; and 
even impossible to say how much of the student's reaction is 
a pure memory prodvict; but in the intelligence tests, the other 
qualities are momentarily in focus and inemocy is not. This 
is in itself a great gain. But for the analysis and the discovery 
of the teaching personality still other qualities must be brought 
into focus, qualities that are wholly absent from or are present 
only by implication in the intelligence test. 

For the sake of conformity to familiar terminology, T pro¬ 
pose to derive a “ Teaching Personality Quotient,” Our study 
at the New York State College for Teachers divides the matter 
into four phases, comparable roughly with, and including the 
Intelligence Quotient. These phases are as follows: A Per¬ 
sonal History Quotient; an Intelligence Quotient; a Behavior 
Quotient; and a Special Information Quotient. 

(1) The Personal Histopr Quotient. The personal history 
of the prospective teacher is the first phase in point of time. 
It has many elements. Environment shapes personal char¬ 
acteristics. Nationally and the occupational history of the 
family are to be recorded. The cultural background of the 
family states the educational opportunities of parents and 
grandparents and indicates the character of the student's home 
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life. Tile htf^h •^cliOfil record conliiilH's to r<fc<»nl l!n.- stufletit’s 
scholastic uchievcincnl.s as in the past. A plw^ical exviniiiiatiun 
throws liifhl on llie sUideiit's jiliysical :uii| imaital cuiulilinn. 
There will lie a careful rc:c*»nl rcKanliuii; ihc vMcaiinnal, avi>- 
cational and rccreatiotial liiltiresls '><1 far as such imprests 
have become dellnile. And ilwi slutlenl’s achtevcineiUs will In: 
tabulated—acliievcmenls in W:irU:rslui», in nriiiiniziiliiui, in 
carrying rcs|nmsihilily, in rxhiliiiii)^ ciniragc. pcT.-^islcna-, in- 
dustry, etc. TTu; persattai hisiory i/iro/iVuf will serve as the 
basis for professional ^uulaiicc ihnmRhoul the educating 
period. Merely to Mate the case fur this (jiioLicnt i.s to show 
its imrTieii.se superiority over Ihe present imulivjualo inatriat- 
laiion process, consisthiK as it does, almost exclu.sively of the 
scliolastic record. 

(2) The Intelligence Quotient. The inteJligcrice test will 
be first of all coniirmaiovy of the personal hi.'^tory. It will 
illuminate the scholastic record as contained in llie high school 
certificate or in the entrance exaniiiiation. It will be invalu¬ 
able ill checking our conventtojial judgnicMit.s on .scholastic 
attainment. Rut the intelligence riuoticnl will do much more. 
It will furnish an index oC intellectual power, which, taken 
in conjunction witli the student’s record of voutliful achieve¬ 
ment, will enable the college to understand shortcomings and 
to provide intelligent corrective measures for failures in specific 
things, For example, if the test discloses a relatively weak 
power of a.s.socialion, reason and judgment, the correct diag¬ 
nosis may he followed hy appropriate prescriptions. This fact 
gives greater importance to these dements in the intelligence 
(quotient than to such elements m mental alertness and reten¬ 
tive memory whicli will probably not yield greatly to training 
and education. In this respect our use of the intelligence 
quotient differs radically from the use made by the army. 

(3) The Behavior Quotient. It is not unusual for students 
to make violent changes in their social habits when they pas.s 
from school to college. Leadership demonstrated in the school, 
may not be in evidence in the larger social group. Avocational 
interests may be clianged. Even vocational interests may be 
affected by the new environment. The persistence exhibited 
in the school, the purposefulness of the earlier time may not 
be apparent. These change.s in behavior are insignificant in 
our present scheme because we make no effort to build the 
college life in consistent fashion on the life habits developed 
in the pre-college period. Viewed merely as an intellectual 
process, the college career has only incidental relationship to 
thi.9 body of Jjabit which accompanies the entering Freshman. 
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But in a larger scheme of personality cultivation it is extremely 
important to insure continuity of development for such funda¬ 
mental characteristics as were noted above, persistence, pur¬ 
posefulness, leadership, vocational and avocational interests. 
Unfortunately the college has not yet sensed its responsibility 
here, and has no machinery for the discovery of personal 
characteristics, for the systematic and continued development 
of well defined qualities, for the strengthening of qualities 
that appear weak or only nascent as yet. I believe this is an 
unscientific procedure in all higher education. Teacher train¬ 
ing surely cannot attack its problem intelligently without this 
systematic study and continuous development of these simpler 
phases of personality. 

The Behavior Quotient will set up this desirable basis of 
personality cultivation. It will rate the Freshman on those 
points which determine character, those qualities which give 
color to his behavior in the class room, among his associates, 
in all social relations, everywhere. The rating for behavior 
must of course be restricted to those ‘qualities which can 
either be tested under controlled conditions, or which can 
be observed and recorded with accuracy. The Freslmifan will 
readily suspect the purpose of the test and yield the expected 
result because he detects the desire of the tester. This will 
vitiate the results of the test. Consequently, it will be highly 
important to select those qualities of conduct, emotional and 
volitional and intelleclual, which lend themselves best to the 
purposes of the test. In fact, it will require long and patient 
endeavor, with a study of hundreds of cases, to establish re¬ 
liable results. But of this I feel certain at the outset. A small 
list of qualities may be tested under strict laboratory condi¬ 
tions, and other qualities may be observed and tabulated dur¬ 
ing the college course. 

(a) Behavior by Test. I propose the following list of quali¬ 
ties for the determination of the behavior quotient by test. 
Some of these may later have to be eliminated, others may 
be brought in as more desirable. Each constitutes an im¬ 
portant part of the teaching personality, 

(1) Sympathy zvith and understanding of children. The in¬ 
stinct of play is absent in some persons. The playful child 
annoys them. Naivete is incomprehensible to these people. 
Fairy tales, childish imaginings are foolishness to them. The 
absence of this quality will be a veritable blindspot in the teach¬ 
ing personality. 
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(2) Rcsonrcefuhtcss. The ability to use ways and means 
.nat are not superficial or readily apparent, constitutes an in¬ 
dispensable clement of teaching personality. 

(3) Directive ability. The ability to determine the direction 
which a group of people or a class shall take in thought or 
action, 

(4) Self Control. The ability to reserve judgment, to resist 
seductive suggestion, to control the emotions, to maintain 
equanimity in spite of provocation. 

(5) Tact. This is a composite of many qualities but for 
purposes of testing is conceived to be the power of quick 
analysis of a social situation, a correct understanding of the 
requirements, and a rapid marshalling of forces to meet the 
situation. Tact brings the best solution with the least irrita¬ 
tion to the situation. A rare, but an indispensable quality in 
the teaching personality. 

(6) Purpose. A clear view of things as they ought to be 
and a definite desire to make them so. 

(7) Organising abiUiy. The ability to adopt means to 
ends, whether the situation be mental or physical. 

(8) Speed of Reaction, The ability to respond rapidly to 
social situations. 

(9) Aesthetic Sejise, A sense of beauty; good taste; pride 
in personal appearance, including neatness and cleanliness, 

(10) Htivior. A cheerful view of life; a right sense of pro¬ 
portion; the habit of correct self appraisal, understanding the 
relationship between dignity and self-conceit. 

(11) Pervasive attention. The ability to give primary at¬ 
tention to one thing and at the same time attend in secondary 
degree on all objects within the sensory field. This is a pre¬ 
requisite to class control. 

There will probably be immediate agreement that the quali¬ 
ties named are fundamental if not indispensable in the teach¬ 
ing personality. But can they be tested.? Our presumption 
is that social situations can be constructed and questions asked 
regarding the conduct recommended, which will clearly define 
the character of the student under test. For example; 

“ Of a number of recorded actions, which do you approve? 

“ Given these or those conditions, what will you do? 

" In a specified and complicated situation, what solution do 
you offer?" 

A faculty committee in the New York State College for 
Teachers is at worlc on the construction of tests. The plan 
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is to extend the nietliocl of the intelligence lest so .'is to cover 
cases where intelligence, together with feeling and will, alTcct 
social situations in the form of concrete hchnvior. The list 
of qualities was selected from a large total; Dr. Fairchild's 
“Perfect Hnman Being Chart" for insunicc, was rich in sug- 
gestivene.ss; but the question, C-ni it lie tested? reduced the 
list to the qualities named. 

(b) Behavior-by Observation. There are iiualiiie.s that can 
be observed hut cannot be disclosed ami apjo'aised hy test 
under controlled conditions. They are fully as iiniiortaiit as 
any that have been named and will shed much light on the 
teaching personality. ' The behavior quotient cannot be deter¬ 
mined with finality without them and so otlier means must 
he devised for their study and appvais'al. This means lies iu 
the systematic observations hy those iiicmbcis of a faculty 
who have frequent opportunity for such study. This is the 
major officer in many institutions, lie who givo.s llie funda¬ 
mental courses which form the major iiUcrcsi of the .student; 
he who advises the student on all matters ])evlain}ng to elec¬ 
tives and the satisfaction of llic rcqiilrcmeius leading to grnclu- 
ation and to a degree. This same officer, may also, in the 
school of education, give instruction in the sjujcial method 
offered in the major subject. His judgment is based on many 
meetings, after observing the student in many situations, and 
should coniiiiand correspondingly great resjiecl. Other in¬ 
structors may have opportunity for such systematic observation. 

The qualities to be submitted for this type of personality 
study are the following: 


Enthusiasm 
Industry 
Responsibleness 
Cooperation 
Aesthetic Sense 


Adaptability 

Loyalty 

Respectfulness 

Poise 

Independence 


A special rating card will be provided and a definite set of 
values assigned. 

(4) The Special Information Quotient. This consists of 
the student's record in his major and minor courses, his schol¬ 
arship record generally, and his work in special method. This 
record can be compiled finally, only at the end of the college 
course and^ will be valuable in guiding the prospective teacher 
into a position but not in guiding him during his period of 
preparation. This phase of the study offers nothing different 
from the usii.r! college scholarship record. The variation lies 
rather in the use that is to be made of this record. Hereto- 
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fore schoiai'ship rating was the only definite judgment passed 
on students, By the proposed plan it will take its place in a 
larger scheme. 

It is not time to propose final relative values ior each of 
the quotients here proposed. Oiir investigation has not pro¬ 
gressed far enough for that. But it is already clcai' that the 
plan will he helpful in passing judgment on the graduate who 
seeks reconunendation to a teaching position, That the em¬ 
ploying agency—school superintendent or trustee or college 
president, will find a judgment based on such a personality 
frame trustworthy, is also quite likely. That such employing 
agency would scan the personal history quotient and the be¬ 
havior quotient with as much care as the special information 
quotient is at least probable. 

The personality study here proposed seeks to do three specific 
things. (1) It endeavors to bring together under Hie four 
heads, all the evidence regarding the student’s personal char¬ 
acteristics and to provide the information needed for pro¬ 
fessional guidance. (2) It seeks in extreme cases to enable 
the college or the school of education to advise individual stu¬ 
dents against preparing to become teachers, or against con¬ 
tinuing such jn-eparation already begun. (3) It seeks to 
provide an intelligent basis for genuine personality cultivation. 
By shifting the center of emphasis, even slightly from schol¬ 
arship alone, hy bringing in elements of character and char¬ 
acter building, it will make of teacher training what it should 
be, a process of discovering and developing the dynamic iier- 
sonality, The chief value will lie, not in the elimination of 
the minus personality, but in tniining and developing the plus 
per.50nality. By discovering in each individual student the 
best combination of personal qualities which he possesses, and 
by the nurture of this innate strength, the educating process 
may compensate his defects. For we all have personality 
negatives. It is the projective power of our pins character¬ 
istics, that wins success, that determines the size of the teach¬ 
ing personality quotient. 
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By Max FREvr, Research Fellow. Carnegie Instilulc oi Teclinology^ 


The present study was begun as an attcnipl to ilevisc and 
evaluate a series ol psychological tests for use iu vocational 
selection and guidance in the field of journalism; more specifi¬ 
cally, to provide for college instructors in jourualism a means 
of foretelling the probable success of tlieir shi(1lmi[s as re¬ 
porters. The advantages of such tests to both .student and 
instructor need no great elaboration: they provide for the 
elimination of unfit students from classes in jouriialisiii, en¬ 
abling the instructor to give more time and attention to those 
who have the requisite ability, and sparing the unfit student 
the years of effort to acquire information which will bring 
him no adequate return, 

The criterion by which the tests will eventually be evalu¬ 
ated is success in newspaper reporting after graduation from 
college. Tli.ey will be given to a sufficient number of under¬ 
graduates to insure a thorough trial. In technique this study 
resembles closely that of Dr. L. L. Thurstoue’s study of engi¬ 
neering aptitude; the tests will be given to jounialisin stu¬ 
dents, preferably in their first year at college, and the test 
scores will be compared with criteria of progress in college, 
and eventually with success in reporting after graduation. 

The difficulties usually met with in such analyses were 
encountered In determining the traits of the successful re¬ 
porter. Text-books of journalism are full of psychographic 
pictures of the profession. Munsterberg, in his “Vocation 
and Learning," listed what he thought were the qualifications 
for reporting, These analyses consist mainly of moral quali¬ 
ties whose presence in a remarkable amount might well be 
conceived as constituting a drawback to success. A study of 
reporters on the job, discossious with newspaper meu, and a 
careful sifting of the literature on the subject, led me to the 

^The material in this report was gathered at the University of 
Washington during the academic year 1919-1920, The writer is in¬ 
debted to Dr. Stevenson Smith for advice throughout the study, 
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coiicliisioii (lirit (lu: fdllowiiijf traits, ahov'e others, were re¬ 
sponsible for rcfmrtiiij;:; 


High degree of iiUelligeucir 
Brorid rniigc of ioforitintioii. 

especially on current events 
Good iiR'iDory 
Language ability 


Soi'inl aljiliiy 
'■ Nose for iiewii " 

'■ Nerve ” 

Keen iiilcresi in rcjiDriing 


Tests were devisod fur all except social iihility. “nerve." 
and intciesi in reporting. Kect.'iu refitietucnls in tests for 
volitional and social trails and in the use of iiittne.st qiies- 
tionnaircs niake it j>rj.s.si)))c to provide objective measures of 
a!) the items in the list in any fiilnrc study along tliis line, 


i. The Tests 

The series originally used consisted of nine tests printed 
lit booklet foetti for group testing and so arratiged that only 
one test was visildc at a lime. Hach fc.st was timed, and the 
whole seric.s could be given during the regular cla.ss jieriod, 
A revised scries is being used, at prcsciu, i)Ut all the results 
given herein were obtained with the original series. 

The following descripiion of the tests is accoinpiiiuerl by a 
statement of the purpose for which cacli test was devised, 
The tests, of ccnuhc, measure a multitude of otlier character¬ 
istics besides lliu ones mentioned, i)ut our assumption is tliat 
they measure tiic traits mentioned more cfiicicntly than they 
do other traits. 

Te.st 1 is intended to measure the coin()lcx ablliiy known 
as "a nose for news.” which means the ability to .see an 
event immediately in terms of its ncAvs value and to recognize 
the items that would be of the greatest interest to the greatest 
number of readers of a newspaper. The term may also be 
taken to include the ability to know where to look for news. 
It is probably acquired largely through training, but Ihe extent 
to which the student possesses the ability before his training 
may he indicative of his future performance in the vocation. 

This test consists of ten pairs of statements, ail of which 
refer to a tenement house fire. The subject is required to 
indicate by a check which of the items in each pair would 
be more important in a news story of the fire, as-snming that 
he is reporter covering the fire for a newspaper in tlic city 
ill W'hlch it nccuned. In constructing the test an effort was 
made to pair an item of major importance with one of minor 
importance. The following are saniiilesi 
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( ) While responding to Ihe alarm, a hose truck skidded into a tele¬ 
phone post, but was not damaged and proceeded to tlic fire, 

( ) The tenement house was a ihrcc-slory brick building, erected in 
1880, 

( ) At the time of its construction the building was one of the show 
places of the city. 

( ) A crowd of several hundred people watched the fire. 

( ) The firemen had difficulty in preventing the flames from spreading 
to neighboring buildings. 

( ) The fire started at 6 ;30 a. m. and was not put out until 0:30 a. m, 


In order to determine the "correct’* answers, this test was 
sent to the editors of forty leading newspapers of the country 
and to a number of instructors in journalism. The items in 
the test were evaluated on the basis of the nineteen answers 
which were received. In most cases there was a large majority 
for one of the items in each pair.’ 

Test 2 has a purpose similar to that of Test \, namely, 
to find out how well the student can solve problems in report¬ 
ing without previous practice. The test ponsists of fourteen 
situations which might confront a reporter,, to each of which 
three solutions are offered. The subject checks with a number 

’In scoring this test, it is desirable that three factors be taken into 
consideration: (II The value assigned to the right an.swcr mu.st bear 
some relation to the percentage of the total votc.s cast that it received; 

mvist be pewaUied, since Vbere is a choice between oni^ 
two answers; and (3) The difference in score between checking the 
right answer and checking the wrong answer in a pair must be pro¬ 
portional to the value assigned to the right answer. 

Let X represent the total number of voles cast for both statements 
in a pair, and let y represent the nunibcr of votes cast for that state¬ 
ment which received the greater number of votes. By assigning values 
to the right answers in proportion to the ratio y/x the first factor is 
^coimtcd for, Values were assigned lo the right statements accord¬ 
ing to the following table: 

y/x Value assigned 
.50 to .55 0 

.56 lo .65 1 

.66 to .75 2 

.76 to .85 3 

.86 to .95 A 

.96 to 1.00 5 

In order to account for the second and third factors the same amount 
IS subtracted from the individual's total score for checking a wrong 
answer as would have been added to it if he had checked the correct 
answer, Thus a difference in score between checking the right answer 
anci checking the wrong one is always double the credit assigned to 
the right answer. 
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j ihc 5(jhilion which ho cunsidors ihe best ot ihe throe, and 
with a 2 the scicc»iul best solution. Sample (iticsUons are; 

If you were assiKunil to K«l llic lads abaut a bank failure, whal 
would you do first? 

() Go to Uk' bank ai\d knock al the (Ujor.s. 

() Call Ibo bank on the. iihonc. 

( ) Call up tho oflicp of the bank csamiiier. 

Wliat wtiuld yoif fk* if a Kroaf lire broke otif n few hours offer you 
])a(l (full work lor fin- iby? 

( ) Muni uji ilic owner of ihc prttficriy and inlervicw him. 

( ) Call up your 

( ) Gel all (be data you could about ibc fire from ilircci observalion, 

Whal would you <Ui if n promincni man ijavc you a copy of a speech 
111 ' was aboni m deliver before a lar^c audience, and while 
tleliviirin^ it lie made sonu’ extreme siatcmoius that did not 
aiipcar in (lie written copy? 

( ) Look him up uiol ask him if be meant those statements (or 
pulilication. 

( ) Leave iliose remarks out of your account, as probably being due 
In ibe I'xcileineiil of the occasion, ami not expressing his real 
lioiiil of view. 

( ) Include ibcisc statements in your account, along with the written 
spoedi. 

In order Co itvaluale the answers, this Lest was sent to the 
same Kroiip as ilie. firsl test. In ail except three of the proh- 
ienis lliere was a very larRC majority for one of the three 
answers. So many of the men overlooked registering' their 
second choice that it was decided to score the test merely on 
the first chnice, 

One criticism of this lest which is not without point is 
that the .subject if actually confronted with the situation 
would not do wh.it he ifidicated. It is probable that the same 
may be said of the editors who filled out the test. The test 
merely .sliows how well the .student agrees witli editoj'S of long 
experience in solving tlieorctica! problems. 

Test 3 mcasure.s auditory memory for meaningful mateiial, 
A short selection .salnrated with facts is read to the students, 
after which they are shown a printed copy of the selection 
in which blank lines have hetm snbstitiUcd for many of the 
important facts. They are asked to fill in the gaps from 
memory. The test is .scored by means of a stencil which is 
placed over the printed cojiy, 
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Tests 4, 5, 6, and 9 were intended to he measures of varU 
oils phases oi language ability. The following nve taken 
from Test 4: 

( ) karned Possessing infornialion 

( ) educated 

( ) informed 

( ) narcotic Having llic quality of cousiiig iiisciisibilily or 

( ) astringent stupor. 

( ) sedative 


( ) autonomy The power, right or condition of seli-govcnmicnt. 
( ) freedom 
( ) emancipation 


The subjects place a check before the one word in each 
group to which the definition applies. This may l)e called 
a test of care in the use of words. Its main disadvantage 
is its brevity, since only twelve definitions cire u.se(l. 

Test 5 consists of an exciting extract from Rcadc’s "The 
Cloister and the Hearth," in which a number of typograpliical 
errors occur. The frequency of the errors is directly pro- 
poitioual to the thrillingness of the raaterkvl; the first part, 
which is comparatively slow, contains few errors, whereas 
the last paragraph, which contains one of the most thrilling 
climaxes in literature, is full of ty(iogr.-iphical errors. Be.sides 
its intended function as a test of one phase of language ability, 
the test offers some analogy to being assigned lo re()ort a prize 
fight; the excitement of the occasion may caiuse the reporter 
to forget his mission. 

Test 6 consists of four lists of words, as follows; 


I 

thief 

pickpocket 

bandit 


II 

to give 
to award 
to donate 


III 

assemblage 

crowd 

audience 


IV 

lo say 
to Hjicak 
to alter 


On blank lines below each list the subject enters more words 
with meanings similar to the three in the list. One great 
difficulty with this test consists in the scoring. There are 
a great many words just on the boi'd^rline between similar 
and dissimilar which cannot be scored either way witliout 
injustice. Intelligent students probably tend to be more dis¬ 
criminating in the choice of the words which they write 
down. In scoring, most of the borderline words were con¬ 
sidered correct, 

Test 7 is constructed on the method suggested by Stern 
for establishing the validity of testimony of a witness. The 
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subjects arc asked fifty questions covering the details of a 
picture which they were allowed to look nt for one minute. 
The picture shows a collision between an automobile and a 
street-car, and is full of detail. The questions cover such 
items as the license inimbcr of the automobile, the amount 
of damage to tlie automobile, ,the number and route of the 
street-car, the iiuinher of the motorman and the policeman, 
the time of day (shown l)y a jeweler’s clock), the month and 
day of month (shown by a sale sign over a store), and year 
(licen.se pad of the automobile). The function tested seems 
to be related to tlie reporter's task. 

Test 8 is similar in form to Alpha Test 8, but the items 
are of the kind that a reporter might be expected to know. 
The following are illustrative; 

GOTHAM is a nickname of CHICAGO. NEW YORK, PHILA- 
DELITHA. nOl^TON. 

IRVIN COHB is a BASEBALL PLAYER, CARTOONIST, AU¬ 
THOR. ARCHITECT. 

The present POPE is CtaUcd BENEDICT, PIUS, LEO, INNOCENT. 
Tlic United Stales declared war on Germany in 1915, 1916, 1917,1918, 
MERGENTHALER perfecied the LINOTYPE, COMPTOMETER, 
TELEGRAPH, MIMEOGRAPH. 

There arc sixty .such items in the test. 

The student who gets a high score in this test has shown 
enough interest in his chosen profession to acquire informa¬ 
tion, through newspapers or periodicals, which will be of use 
to him later on. 

Test 9 is a word-building test, using the letters : A E I O L 
N R T. All words constructed must have four or more letters, 
Word-building tests have been classed as measures of verbal 
imagination, 

The total score was computed simply by adding the scores 
in the individual tests, A correlation coefficient of ,97 was 
found l)etween this method and that of adding ranks in the 
individual tests. No attempt will be made to weight the tests 
until they have been finally evaluated. 

2. The Subjects 

This series of tests was given to nine groups of subjects: 

A. 29 Juniors, School of Journalism, University of Washington. 

B. 16 Seniors, School of Journalism, University of Washington, 

C. 47 Freshmen School of Journalism, University of Oregon, 

D. 24 Sophomores, School of Journalism, University of Oregon, 

E. 18 Juniors, School of Journalism, University of Oregon. 

F. 7 Seniors, School of Journalism, University of Oregon. 

G. 85 First and Second V<»ar~H it! v 

Washington. 
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H. 35 Third ard Fourth Year Non-Journalism Students, University 
of ’Washington. 

J. 10 Reporters, 

All of these groups except J were tested during January 
and February, 1920, Ihe first six groups tnclvide most of the 
students in the classes from which they were drawn. At the 
University of Washington the School of Journalism is open 
only to upper-classmeu. It was Litipossihlc to test the Pre- 
JournalisjTi students in the College of Liberal Art.s. Groups 
G and H were composed of students enrolled in a class in 
Applied Psychology. They were for the most part in the 
Colleges of Liberal Arts, Education, and Science, The re¬ 
porters, who were all on the staff of a. metropolitan news¬ 
paper, were given the tests under conditions which almost 
warrant discarding their scores. The men varied greatly in 
age, education, and experience. 


3. The Results 


While final evaluation‘of the tests as indicators of success 
in reporting must be delayed a number of years, a study of 
the scores may throw some light on the possible future value 
of the tests. 

Some tentative statenients about the tests arc suggested by 
the comparison of the median scores for the various groups 
in each test, Table I gives this information. 

TABLE I 

Median Score for Each Gnoop in EACiiTBsr. A Shorteh Time Limit was AI-lowbd 
IN Giving Test 9 to Groups G ano H. Tests S. b, and 9 wehe not 
Given to Group i. The Theunes UMnsn Uange adk the 
Lowest and {Iiciiest Scores Actuallv Made 


Teat 

1 ..., 

2 .... 

3.. .. 
L... 

5.. .. 

6 .. .. 

7,,.. 
0 ..., 
6 . 
Total 
Score 


A 

B 

C 

D 

Group 

£ 

F 

G 

It 

J 

Riingo 

•at .0 

37.5 

2&.6 

31.5 

21.5 

ai.o 

31.0 

;n,fi 

35.n 

0-50 

HI.7 

45.0 

33.5 

34.5 

36.0 

39.5 

32. :i 

34.5 

.11,0 

5-61 

1G.3 

16.5 

13.6 

12.0 

13.0 

14.0 

10.7 

9,0 


0-91 

7.5 

7.9 

B.-l 

6.2 

7.0 

6.8 

6.3 

5.51 

'7i() 

l-Il 

20.5 

32.0 

19.0 

20.8 

16.0 

IB.O 

IB.O 

15,7 

27.5 

0-59 

13,7 

M,6 

13.7 

U.3 

U.6 

14.0 

13.3 

12.0 


3-ao 

15,0 

17.0 

12.S 

13.4 

11.8 

11.0 

13.0 

M.O 


0-34 

21.5 

31.5 

18.0 

19.3 

17.5 

21.0 

J8.3 

18.3 

.31-5 

3-53 

0.7 

0.3 

7.3 

9.2 

8.3 

6.5 

3.0 

3.-1 


0-18 

. 172,5 

201.5 

1-19.0 

162.5 

161.0 

152.S 




32-29,1 


The University of Washington journalism seniors excel the 
juniors in all of the tests, but for the University of Oregon 
students Test 2 is the only one which shows a relationship 
between median score and year in college. 

The University of Washington students of journalism a.s 
a whole are distinctly superior to the non-journalism students 
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in all of the tests. Non-]ournaUsm uppec-classmen and lower- 
classiTien do about equally well in the tests. In Tests 1, 2, 
5, and 8 the reporters do better on the average than the 
journalism students. Some of the tests seem to distinguish 
between those who have journalistic inclinations or ability 
and those who have not. 

The correlation coefficients given below were obtained by 
Pearson’s method of correlation of grades, the formula being 

r=2 cos 1, in which R=l_ 

o Pv *—1 

Each test was correlated with Alpha (54 cases), with the 
following results •. 


Test 

1 . 

2 . 

3 . 

4 . 

5 . 

6 . 

7. 

a. 

9. 

Total Score 


.36 

,45 

,58 

-48 

.69 

,30 

,41 

,65 

.43 

.56 


These figures arc low enough to allow for differences of 
an appreciable amount if both series of tests are correlated 
witii an objective criterion. 

Test 8 in the present series and Alpha Test 8 show a corre- 
lation of ,62. Tests 3 and 7 correlate .40. 

The instructors in journalism were asked to rate their stu¬ 
dents on the Journalistic aptitude which they displayed. These 
(acuity estimates may not be correct, but a student leaving 
college with the recommendation of the faculty will have his 
classmates at a disadvantage in obtaining his first position. 
On the other hand, many students who are considered poor 
material by their instructors may be given a start by friends 
or relatives and prove very successful. It remains to be 
seen what predictive value the faculty ratings have, and 
whether or not the tests predict the students' future success 
more accurately, 

The University of Washington students were rated by 
three faculty members and the University of Oregon students 
by two. With some unimportant variations in wording, the 
following .simple scale was used; 

“Rate each of the students who took the journalism tests 
as follows: 













54 


FREYD 


" 1, if you think that the student has an aptitude for journal¬ 
ism and if you think that he will succeed in newspaper work, 
“2, if you are doubtful about the student’s aptitude or do 
not know him well enough yet to care to pass judgment on him. 

"3, if you think that the studait has no aptitude for journal¬ 
ism and will not make good in newspaper work.” 

Each student's ratings were averaged to obtain liis final 
rating. Correlations with test scores are given in Table II. 

TABLE 11 

Correlations of Faculty Ratings with Test Scores, All Figures 
ARE Positive Unless Indicated Negative. Under Average 
ARE given the MeANS OF TOE Six COEFFICIENTS FOR 
Each Test 

Group 


Test A B C D E F Average 

1 , , — 20 .34 .29 —.04 . 47 —.42 . 07 

2 .13 .45 .31 —.35 .32 .32 .20 

3 .18 .42 .29 .40 .63 .42 .39 

4 .43 —.30 .36 . 00 .11 .50 .18 

5 .26 —.07 .28 .35 —.04 .73 .25 

6 .39 .67 —.18 —.11 .04 .52 ,22 

7 . —.08 . 54 . 26 . 24 —.07 . 00 .15 

8 .13 .54 .61 .46 ,38 .12 ,37 

9 .13 . 62 .09 . 57 —.06 , 21 .26 


Total'Score; .23 .75 .'28 .19 .'26 !58 '38 

These figures show that in general the more advanced the 
students the higher is the correlation between test scores and 
ratings, The amount of correlation also varies inversely as 
the size of the group tested. Supposedly instructors are better 
able to judge the ability of their students after knowing them 
longer and meeting them in smaller groups. Selection, how¬ 
ever, places a practical limit on the increase in correlation, at 
least with the present rating scale. If the courses in journal¬ 
ism were extended beyond the customary four years we should 
eventually find every student rated 1. 

Passing to the correlation figures for the individual tests, 
we find that Test 6 is the only one whose figures show a 
consistent increase with year in college. Test 8 shows an 
increase for the Washington students and a decrease for the 
Oregon students. For Group B Tests 4 and 5 correlate nega¬ 
tively, whereas for Group F they show a high positive correla¬ 
tion. For each of the tests there is one coefficient of +,45 or 
more, and for seven of them there are one or more negative 
coefficients. Tests 3 and 8 have no negative coefficients. We 
may conclude that as far as this tabic is concerned, Te.st 5 
3, 6, and 8 ate the most efficient. 
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The scores were available for Groups A and B in an intelli¬ 
gence test devised for the purpose of picking officer-material 
from among naval recruits at the University of Washington 
during the late war. The test consisted of six parts; can¬ 
cellation, opposites, memory span, true and false statements, 
parts of fifty, and perception of number,® The correlations 
between this test and faculty ratings on journalistic aptitude 
were ,14 for Group A and .37 for Group B, in both cases 
considerably lower than the correlations obtained with the 
journalism tests. 

No Alplia grades were available for any of the journalism 
students, but many of the non-journalism students had been 
given the test, The correlation figures on page 53 were ob¬ 
tained on non-journalism students. We may find out in¬ 
directly what common factors there are between the ratings 
on journalistic aptitude and Alpha scores by correlating the 
coefficients of each test with Alpha given above (page 53) 
with each of the seven columns of coefficients in Table II.* 
The following are the correlations obtained: 

Group A B C D E F Average 
r .41 —.38 .57 .53 .18 ,61 .45 

If these figures arc taken as probable indices of the amount 
of correlation between ratings and Alpha, we see immediately 
tliat with the exception of Group F the instructors tend to 
rate their .students at first according to their general intelli¬ 
gence and .'i.s tlicy know lliein belter they rate them on another 
ability which is closely related to those measured by the jonv- 
naliatn tests. 

4. Summary 

1. For some unknown reason the tentative criteria .show 
more positive results with the University of Washington stu¬ 
dents of journalism than with those of the University of 
Oregon. 

®Tlie “part.s of fifty “ test consisted of twenty rows of eight figures 
each. Two fiBurc.s in encli line added together equaled fifty. The 
subject was required to cross out these two figure.s in each line, The 
“perception of number" test consisted of sixty rows of circlc.s, The 
subject was required to write on a blank line after each row the 
mnnber of circles in the row. The circles were at even distances ap.irt, 
so that it wa.s not necc.ssary to count out the number of circle.^ in every 
line. In case a line contained more circles than the preceding one, it 
was merely necessary to add the niimbcr of circles cxleiuling bcyoiul 
the preceding line. 

^ For a llicorclical discus.sioii of tlij.s method, the reader is referred 
to Hart and Spearman: "General Ability, Its Existence and Nature," 
Brit. Jour, of Psycho}., Vol. V, 1912. 
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2. Tests 1,2,5, and 8 tend to distinguisli bctwcLMi reporters, 
students of journalism, and non-journalism students. 

3. In general, faculty ratings on the aptitude of their stu¬ 
dents agree closer with test results when the instructors meet 
their students in small groups than when they meet them 
in large classes. 

4. In general, the longer the mstructors know the students, 
the closer do their ratings agree with the journalism test 
scores. 

5. The scores in Tests 3 and 6 show the most consistent 
agreement with faculty ratings. 

6. The results lend support to the analogy method of dc’ 
vising tests. 

The final evaluation of the tests must be delayed until the 
students have been out of college for five or ten years. In 
grading them on their success a rating scale will be used 
which will contain such items as the importance of the news¬ 
paper on which the man is employed, importance of his posi¬ 
tion, his salary, etc. 

A revised edition of the test series was printed during 
March, 1920, and was given to students of journalism at the 
Universities of Minnesota, Illinois, Indiana, Kansas, and Iowa, 
and Ohio State University. Copies of the revised series may 
be obtained by addressing the writer at Carnegie Institute of 
Technology, Pittsburgh. 



TESTS IN INDUSTRY* 


Hy Mohhis S. Vitkles, A. M., Ui\iversiiy of ruiinsylvania 


The vdcalioiuil psychologist concerns himself with finding 
the right iniin for the right job. There are two avenues of 
approridi lo lliis: that of choosing a ivorkei' to fill a par¬ 
ticular job and that of choosing the job which is most suit¬ 
able for the jiarticular worker. Incliislry is interested in get¬ 
ting the worker for the job and concerns itself little with the 
latter and more diftlctdt proiileni which confronts the voca¬ 
tional counsellor. Both problems, however, involve an analysis 
of jobs from the point of view of the specific mental abilities 
which the worker must possess in order to attain proficiency 
ill any one of them and the development of scientifically 
accurate measures of such ability. “Tc.sts are the devices by 
which mental abilities can he mea.siircd.'' Industry has lagged 
far behind education in adopting a quantitative standard for 
the measurement of the ability of individmds. It has selected 
the worker haphazardly and the function of selection has often 
been assigned to one of the menials in the executive hierarchy 
of industry. Link, in hi.s Employment Psychology, cites an 
amusing example of this haphazard method of selecting work¬ 
ers. " One large manufacturing concern,’' he writes, " ha.s 
appointed a.s monarch of the ‘ hiring-oii-window ’ a man who 
had the misfortune to lose a leg in the company's employ, 
As a consc(iiience of this loss he was given his present life 
job which he jierforms to the queen's taste. He was induced 
to describe his methods and they were something as follows. 
'On Monday I turns down all the men with white collars, 
on Tuesdays all with blue eyes, Wednesday all with black 
eyes. Red-headed men I never hires, and there do be days 
when I have a grouch and hires every tenth man.’ ” This is 
perhaps an exaggeration, but it illustrates the haphazard 
method of selection which indu.stry still largely employs. 
Numerous examples can be cited which illustrate the important 
part played by the personality and tastes of the employment 
agent in selection. The head of a billing department of a 

’An address delivered al the Conference on "Tests in Relation to 
Vocational Guidance” at the annual incetinp of the National Voca¬ 
tional Gtiidarice Assn,, Atlantic Ci^, Feb. 1921. 
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department store for which I was preparing tests was prais¬ 
ing liis force and, took me on a personally conducted tour of 
his department to point out his star workers. " Now this 
girl,” he said, pointing to one, ” is going to make a ci-acker- 
jack worker, I just hired her this week, but I know it. I 
know that every time I hire a girl with that kind of a face, 
round, serious looking, smart, slie makes a fine hillev. Now 
I must have been asleep when I hired that one. She won't 
make good,” and he indicated a petite, dark-haired girl whose 
features, in my opinion, radiated intelligence and ability. The 
girls whom he had Indicated as the possessors of pleasing, 
intelligent faces to me seemed dull and lifeless. I am free to 
admit that it was altogether a question of personal tastes, but 
it was such personal likes which dominated the choice of work¬ 
ers for this department, and for other departments in the 
store—and resulted in the choice of persuniiel lacking uni¬ 
formity and with greatly varying competency for the different 
jobs in the store. 

It is by reason of this absence of uniformity in selection 
that tests are replacing in industry the haphazard method of 
selection in which the only measure of the applicant’s fitness 
for the job is the judgment of tlic foreman, or even the better 
trained judgment of the employment manager on the basis of 
mere observation, Sometimes those who make the selection 
are using such additional criteria as the confour of the appli¬ 
cant's face, whether it is convex or concave, the length of the 
fingers, the texture of the skin, the shape of the head and any 
number of other unreliable standards which pseudo-scientists 
are recommending to industrial executives. The readiness of 
industry to employ these luetliods is an indication of the 
need which is felt for some more definite criterion of selec¬ 
tion than that of mere observation. 

Two kinds of tests are being used by industry to provide 
these more definite standards of selection;—trade tests and 
psychological tests. The former are being used to determine 
whether the applicants for a job in which experience is re¬ 
quired actually possesses such experience, They are measures 
of trade experience involving tasks which only an experi¬ 
enced worker in the trade can perform. The carpenter is 
given a block of wood, a hammer and a chisel and instructed 
to make a certain kind cf a joint. The inside electrician is 
given material and is instructed to put up some wiring. Such 
tests were used extensively in the army during the late war 
to pick the skilled workers to build cantonments, do electric<al 
wiring, run auto trucks, etc. The psychological tests, on the 
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other hand, are such as measure the ability of the inexperi¬ 
enced applicant for a position to attain proficiency in the job 
for which he is api)lyin|T, The dividing line between the two 
types of tesis is not a clear cut one at times, but the funda¬ 
mental difTereiicc is an essential one. I shall confine myself, 
ill this paper, to a discussion of the psychological tests, with 
particular reference to their use in selection, and not for pro¬ 
motion, transfers, the i-egiilation ot wages and any number of 
other uses to which they are put in industry. 

The psychological tests, may be divided into two classes, 
tests of general intelligence and tests for specific abilities. The 
general intelligence-test, such as the Army Alplia, tlie Binet 
Simon test, the Otis test, and many of the so-called intelli¬ 
gence tests which are being used to grade school children are 
really measures of the performance level of the individual 
The college professor stands higher on the performance level 
than the skilled tradesman, and the skilled worker on a higher 
performance level than the laborer. The higher the perform¬ 
ance level of an individual the higher the score he will make 
on a test for general intelligence, which may be defined as a 
combination of innate specific abilities, educational and social 
opportunities. Such tests have a very limited use in industry. 
They arc used in the first place, to shut out from employment 
the fcehle-ininded, those who are altogether uulit for any job 
in the plant hy reason of deficiency in mentality. They arc 
also used to select workers for jobs in which success depends, 
to a very great extent, upon a high level of general intelli¬ 
gence, namely the executive po.sitions. For .selection for the 
great mass of skilled and semi-skilled jobs, for office jobs 
and simple clerical jobs, the general intelligence test cannot 
be used. The carpenter and the toolmaker, for example, 
must stand on approximately the same level with reference to 
general intelligence, but very different .specific abilities are 
rquired for these trades. 

In an analysis of the tests for general intelligence given 
in the army it was found that laborers and farmers averaged 
C—in general intelligence; bricklayers, cooks, bakers, general 
machinists, shop carpenters and workers in a nuinher of other 
trades averaged C; clerks, photographers, R. R, clerks, etc., 
averaged C-}-. If trade competency correlated with gcneial 
intelligence it could be predicted that everybody wlio ranlced 
C in the army alpha would make an equally good bricklayer, 
cook, baker or general machinist. It is a matter of common 
experience that many bricklayens could not be tnisLcd lo jme- 
pare a meal successfully even after much training, and that 
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many first class chefs could be taught bricklaying for many 
years and would never succeed in aligning properly a row 
of bricks, Trade competency is related to specific abilities 
which the individual possesses. Specific abilities are those 
innate traits which enable an individual to perform some 
specialized task, In the schools we find good pupils who are 
poor in arithmetic, good arithmeticians who do not learn to 
spell well, and individuals who are poor in spelling, arith¬ 
metic, reading and all other school subjects who do remark¬ 
ably well in the classes in carpentry and clay modelling. A 
special set of specific abilities go into each of these, and 
differences in the specific abilities which individuals possess 
account for differences in arithmetic, spelling, reading compe¬ 
tencies and so forth. In the same manner competency for 
different jobs in industry depends upon specific abilities. A 
motorman on a trolley car must possess a high degree of 
distribution of attention, alertness, planfulness and the ability 
to react quickly with a learned response to external stimuli. 
The conductor, on the same car, needs distribution of atten¬ 
tion, alertness, planfulness in a more limited degree, but the 
last complex ability is not needed. The conductor on certain 
roads needs a certain amount of arithmetical competency, the 
motorman need possess none of this. The general intelligence 
needed for these two jobs is about the same, but there are 
many men who make good conductors who would be danger¬ 
ous characters as motormen \sy reason of deficiency in the 
ability to respond with certainty to the stimuli with certain 
learned responses. A girl who wraps locks must concentrate 
her attention on one particular object to the exclusion of all 
others j a girl who inspects locks at the same table must dis¬ 
tribute her attention over a number of different elements of 
the locks. Concentration and distribution of attention are 
two distinct specific abilities. It was found in one plant that 
girls changed from one job to the other failed to make good 
and a psychological analysis of the job explains this failure 
on the basis of the different specific abilities involved in these 
jobs, The tests which arc being used successfully in industry 
are those which measure the specific abilities of individuals 
for particular jobs, and not tests for general intelligence. 

The process of developing tests for industry is a long one. 
It involves, first of all, an analysis of the job from the point 
of view of the abilities involved in its performance. Such an 
analysis can only be made by a psychologist. In some cases 
it can be made by merely observing the worker on the job, 

hltt Ifl mnst if nrfitiitiv ripppccanr 
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to become a worker, to don the overalls of the machine hand, 
the gloves of the motorman, the green shade of the cleric if 
he desires to make an adequate analysis—to understand^ “ the 
mental action for which he is trying to find tests as measures.” 
The next step is to find or devise tests which, in his opinion, 
involves in their performance the same specific abilities which 
are involved in doing the job. For this purpose the psy¬ 
chologist can use, sometimes with only slight modifications 
many of the tests which are in common use, but it is often 
necessary for him to construct an entirely new piece of appa¬ 
ratus, Analyzing the job and preparing the test arc only pre¬ 
liminary steps in developing the tests for paLticuhu- jobs. 
There are two additional steps which must be carried out, 
In the first place the fact that the test is actually a measure 
of the abilities which the job requires must be empirically 
demonstrated, In other words, the tests must be tested. This 
is generally done by submitting workers who are already 
employed on the job to the test and finding out whether the 
more proficient workers actually pass the test with a higher 
score than the less proficient workers. Sometimes, a number 
of tests which seem to involve the same ability are given, and 
these selected which show a high correlation with proficiency 
in the job. Another and longer but better method is to test 
all applicants for the job with the tests which have been 
selected by the first method, to make a record of their scores 
on the test, and to follow them up after they are employed 
at specific intervals to determine whether the individuals 
who made high scores become proficient workers and vice 
versa. (In this connection, of course, it must be recognized 
that there are other factors than inability for which an indi¬ 
vidual is found unsatisfactory in industry, and that the test 
measures only this, the most important factor in satisfaction.) 
The other step is to provide quantitative standards for selec¬ 
tion. The standards must be m terms of vmits or of times, 
and the exact point which employment is advisable must be 
indicated. Such points, critical levels they are called, can 
only be established empirically, and as more applicants are 
tested the standards so established are revised and refined. 

It is necessary to recognize that tests which are being 
used in industry overlook an important feature—tempera¬ 
mental differences between individuals. Two men may have 
the same specific abilities; both may have equal competency 
for a particular job, but one may be a willing worker, the 
other may be an unwilling worker. One may be tempera- 

^Link. Employment Psychology. 
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mentally fitted for the job, the other may not. The first may 
be fond of indoor work, the second of outdoor work. The 
vocational psychologist has hardly attempted to measure these 
temperamental differences, largely because little of concrete 
value has been accomplished in the analysis of mental qualities 
which are called ternperamentaL Both for purposes of .selec¬ 
tion in industry, as well as in vocational guidance, definite 
devices for measuring temperamental differences will have to 
be developed before selection can be extremely satisfactory.* 

It must certainly seem,” says Watts in an article in the British 
Journal of Psychology, " that the vocational psychologist will 
need to take into consideration what has so far been overlooked, 
the instinctive make-up of the subjects of his experiments, 
and that in choosing workers for particular tasks he must 
make sure that their instinctive type is the right one. It 
would be folly to place the man with strong gregarious ten¬ 
dencies in lighthouse or wireless work, or advise him to go 
into farming in a new colony, just as it would be unwise to 
encourage a boy devoid of the acquisitive instinct to set up 
in business. And it will be agreed that a soldier or a reformer 
without a considerable spice of pugnacity would be a failure, 
while it is equally beyond dispute that the statesman and the 
priest, the doctor and the nurse, the teacher and the shepherd 
would soon tire of their work if they were not endowed 
strongly with the tender impulse.” The next few years will 
show whether we shall be able to devise tests for the diagnosis 
of the relative strength of man’s various instinctive qualities, 
It would be possible to quarrel with Watt's analysis of in¬ 
stinctive qualities, but the essential problem is well stated. 
In addition to abilities there are motives and purposes in 
the worker's make-up. There are, as has been popularly 
stated, ” ‘ doers who will ’ and ‘ doers who won't ’ and the 
‘ wilier' and the ' wonter ’ present another problem for 
quantitative treatment with tests." That judgment of tempera¬ 
ment made by observation of facial characteristics, color 
of hair and other physical features, which is recommended 
and used by popular vocational counsellors, is unreliable is 
very apparent to the scientist. 

One factor in vocational guidance should be the child’s 
competency for the occupation which he seeks or is being 
advised to enter. The judgment of the counsellor upon the 
presence of the competency is as unreliable as the judgment 
of fitness for a job made by the employment agent in indus- 

*F. Watts, "The Outlook for Vocational Psychology". i?rhWj 
/oiir. of P5yc/ic5l,, Jan., 1921. 
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try. The presence or the absence of such competency can be 
determined by the use of the same tests which are being used 
by industry in the selection of its workers. Associations in¬ 
terested in vocational guidance should co-operate with indus¬ 
try and obtain from industrial plants the tests which they are 
using. Such an association should also undertake an analysis 
of jobs to determine what constitutes-tompetency for par¬ 
ticular jobs and the development of measures of such com¬ 
petency, in the same manner as industry is doing, We have 
passed the time in vocational guidance when jobs can be 
defined in terms of such abstract qualities as good, Jiard, clean, 
desirable, etc, We have reached the point where an accurate 
definition and reduction to measurable terms of job compe¬ 
tency is absolutely essential. 

In the use of tests for vocational guidance it must be 
recognized, however, that competency for a job, as measured 
by a test, is only one factor in guidance. It is combined with 
the child's healtii, his desires, his temperament, and other 
conditions to determine final choice of an occupation. The 
test, however,—the same test that industry uses in the selec¬ 
tion of workers for its jobs can be used in the place of the 
harsher method of trial and failure to weed out those who are 
definitely incompetent to attain proficiency in vocations which 
otherwise seem suitable and to point the way to those whose 
desires are not well defined. 



THE PROBLEM OF THE UNSELECTED GROUP IN 
THE STANDARDIZATION OF TESTS 


By S. L. Pressey 

Studies from the Psychological Laboratory, Indiana University 


I. The Essential ImpossibUity of Obtaining an Unselected 
Group ill IVork with School Children 

The difticiilty ot obtaining satisfactory norms or standards 
for adults for any type of test—of general intelligence, voca¬ 
tional aptitude, or what not—has come to be generally recog¬ 
nized. It is realized that different groups of adults vary 
astoLindingly, in the first place, in the extent to which various 
selective influences have operated to bring them together in this 
particular sample. The subtle extent to which environmental 
influences may also come to have an effect upon a person’s 
performance on such tests is also coming to be appreciated. 
But it seems to be supposed, by some workers in the field, that 
school children make material for thorough standardization 
which may be considered free from the influence of such 
special factors, If there is one single fact which has sur¬ 
prised the writer, from the study of school surveys made 
during the past three years, it is the fact that such influences 
are extremely important and pervasive in the public schools. 
And he has come to the conclusion that standard groups must 
be very carefully defined if the standards are to mean what 
they should for comparative purposes. The purpose of the 
present paper is to present very briefly a few bits of data 
illustrative of the way in which "sixth grade norms" from 
one school system may mean a very different thing from 
"sixth grade norms” from another, nine year old norms in 
one school may mean a very different selection of nine-year- 
olds from the group that would have been gathered under 
similar circumstances in another school—and so on. The 
data are, to the writer at least, extremely interesting and 
involve, he believes, matters of extreme importance, 

II. Age-Grade Dislribulions and Mental Tests 

As illustrative of two types of school system the two fol¬ 
lowing age-grade distributions are presented (see table I). 
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The results are the age-grade tabuktions obtained from test 
blanks used in a survey of these two school systems made by 
the writer and his wife, Jn this work, the “ Primer " scale 
was given to the children in the first three grades, and the 
" Cross-out" scale to children in the grades from the fourth 
through high school.^ Age tabulations from these blanks thus 
result in a complete age-grade census of the entire school 
system at the time when the survey was made. The testing 
was in each case all done within three days and thus gives 
a very satisfactory cross-section statement of the situation in 
these school systems at the time of the examination, System 
C was examined the last of February, System F about three 
weeks later, in the middle of March. These age-grade tables 
are full of interesting facts, only a few of which can be 
mentioned here, 
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^ See Cross-out Tests, Jour, of App. P.\ycho]., June. 1919; aiul A 
Brief Group Scale for Use in the First Three Grades, Jour, of Hdiic. 
Psychol., Sept., 1919. 
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First of all, the question is as to the comparability of grade 
norms obtained from these two systems; the grade norms are 
naturally the first to be worked ont, since the data comes in 
grouped by grade and not by age. The grade distributions 
given above look roughly similar; but comparison of the 
median ages for each grade brings out, at once, differences 
of decided importance. These median ages run. as follows; 


1 2 3 4 5 6 7 B 9 10 11 12 

CitvC 7 35 8.68 9.55 10.90 11.8B 12.90 13.64 14.36 15,11 16.40 17,31 17,95 

CityF',, 6,80 8,12 9.06 10.25 11.42 12.45 13.52 14.36 15.13 15.97 17.10 17.86 

DifT.65 .56 ,49 .65 .46 ,45 .12 .00 —.02 .43 .21 ,09 


These differences expressed in hundredths of a year per¬ 
haps do not look very surprising. But when it is realized that 
the children in the first grade of City C are over six months 
older than the children in the same grade of City F and that 
the children in the fourth grade of City F are eight months 
younger than the City C fourth graders, then one realizes that 
grade norms from City C and City F are not comparable. Just 
what factors biing^ about these results it is hard to say. It 
may be that the children entered school later in the second 
city. Or they may be held bade more in their school progress. 
But whatever the causes may be, the result is unmistakable; 
grade for grade the children of City F are about five months 
older than the children in City C. If one is working with 
tests of mental endowment the situation is bad enough; allow¬ 
ance must be made throughout for this difference in maturity. 
If the work is with tests in the school subjects, the situation 
is almost hopelessly complicated. If the children in the second 
city be found to test higher, this result might be due either 
to greater maturity, or greater time in school, 

Any differences might in fact be due to selective factors 
connected with these facts. Close study of the two distri¬ 
butions will show that in the first city the dull children tend 
to be held in the first three grades. But in the second city 
the incidence of retardation is between the fourth and fifth 
grade. And selection for the upper grades is much more 
severe in the first city. There are practically the same num¬ 
ber of children In the first grade of City C as of City F (166 
and 169 respectively). But only 41 per cent of this number 
are in the eighth grade in the first city compared with 62 
per cent in the second city. It might almost be said that 
the eighth grade children in the first city were twice as highly 
selected. 

When norms are said to be for the eighth grade, then, 
in order to have the nature of the group classified, the median 



THE PROBLEM OF THE UNSELECTED CROUP 67 

age of the grade should be known, the amount of elimination 
and retardation—in fact, the total age-grade distribution for 
the school, In one way or another the total policy of the 
school system has managed to express itself to an extraor¬ 
dinary extent in merely the crude fact of the age-grade re¬ 
lationship. 

So much for grade norms; in dealing with age norms the 
situation is much more complex. The writer would like to 
consider particularly the problem of standardization as it 
appears in work with any one of the group scales for work 
with the upper grades now available. Such scales involve 
the ability to read, and so are not very satisfactory in work 
below the fourth grade. The question is then as to whether 
satisfactory norms can be obtained by age if children only 
above the third grade are examined. It is also interesting to 
consider the influence upon the norms of the admission of 
high school. In the distributions already referred to a brealc 
is made between the third and fourth grade and between 
the eighth and ninth in order to set off the grade school group 
most naturally dealt with in work with such scales. A glance 
at the distribution for City C will reveal the extraordinary 
fact that if only the children from the fourth through the 
eighth grade had been examined, it would have been impos¬ 
sible to obtain complete age distributions for any single age. 
Only for ages 12 and 13 would a complete distribution be 
approximated. Even if we include the third grade we do not 
manage to include all the cases of any one age. Ajid to 
present a series of age norms based on data thus obtained 
approaches rank absurdity. Such norms are warped and 
twisted out of all shape by these selective influences in the 
school system, 

In City F there is a somewhat better situation. By in¬ 
cluding the third grade all the 11, 12, and 13 year old chil¬ 
dren would have been examined. But it is obvious that age 
norms obtained from this city would not mean at all the same 
thing as age norms thus obtained from City C. And tliere 
is a further factor here of great interest. In City F prac¬ 
tically all the fourteen year old children are still in school; 
there are 158 12 year olds in the system and 157 14 year olds. 
But in City C there are 145 12 year olds to 114 14 year olds. 
This elimination had begun to show, in fact, even at thirteen; 
there are about twenty less 13 year olds in City C than we 
would expect. Comparable age norms from the two cities 
would seem, if a scale simply for the upper grades is used, 
an utter impossibility. It is also interesting to notice that 
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age at entering school apparently varies, and that the lower 
ends of the distributions are also difEerent, Thus the first 
city shows only half the expected number of six year olds 
in the school, where the second city shows 75 per cent, The 
situation seems hopelessly special, and the obtaining of a gen¬ 
eral standard next to impossible. 

It is especially interesting to consider in this connection 
that it is altogether impossible, from work in the schools, 
to obtain any unselected adolescent norms. It is perfectly 
obvious that the children 15, 16 and 17 years old who are 
in school are simply a fraction of the total number of children 
of these ages. How much they have been selected it is hard 
to say. The comparative numbers for these ages for the two 
cities mentioned are by no means so different as are often 
found. Thus the number of the 16 year olds still in school 
is 51 per cent of the 12 year olds in City C. But in a third 
system examined at almost the same time, there were 73 per 
cent of the expected number of 16 year olds in the public 
schools. This lack of norms for adolescence is of decided 
importance. The army psychological work did not, of course, 
test this group. And the fundamental fact is that we simply 
don’t know anything about what performance we should 
expect of our delinquent girls, juvenile offenders, or the large 
and perplexing group of adolescents just going to work.^ 

Ill, The Age-Grade Description of Stmidard Groups 

In the light of such data it at once becomes obvious that 
in presenting norms for any type of test some statement of 
both age and grade grouping should be included. There are, 

® It need hardly be said that the results from a single school must— 
if results from an entire school system are unsatisfactory—be largely 
out of the question as a basis for standardization. A town or city is 
more or less of a sociological unit. In such a total community a pro¬ 
portionate representation of all dasses may be expected. But a single 
school may draw largely from a neighborhood made up almost alto¬ 
gether from one class of people; one school may contain almost alto¬ 
gether the children of day laborers, another be in an excellent residence 
district. As an example, selected almost at random, schools X and Y 
in a small Indiana city may be instanced. The median ages for the 
third, fourth, and fifth grades run 9.07, 9-55, and U.OO for the first 
school and 8,06, 9,28, and 10.55 for the second. The first school has 
32 in the third grade as compared with only 18 in the fifth; the second 
has 62 pupils in the third and B7 in the fifth. On the basis of such 
data both age and grade comparisons seem, at first thought at least, 
utterly impossible if anything more than school selection is being 
investigated. (See also "A Comparison of Two Cities and Their 
School Systems by Means of a Group Scale of Intelligence ” Educa¬ 
tional Administration and Sunervision. Vol. 5. 1919. nn. 
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of course, a niiinber of ways in which this may be done. The 
thoroughly scientific way would be to present the age-grade 
distribution; but a summary statement of the age-grade situa¬ 
tion would still be needed. It is becoming a somewhat com¬ 
mon practice in work with educational tests to give at least 
the time of the year when the tests were given. There is 
some effort now to obtain the age norms for these tests in 
the various school subjects. The writer cannot see how, in 
view of the various facts which have just been presented, this 
can be done very satisfactorily. Tests in the various school 
subjects arc rarely applicable over a wide range of ages or 
grades; under such circumstances the obtaining of age norms 
which are reasonably free from the influence of grade selection 
would seem altogether impossible. The writer would like 
to make the following suggestions. 

(1) In work with tests of general ability grade norms 
should be invariably accompanied by the median age, for each 
grade, of the standard group from which the norms are ob¬ 
tained. Time of examining in the scliool year is relatively 
unimportant, A statement of the median age will permit 
allowance for examining at different times of year, and allow¬ 
ances also for differences in amount of retardation and accel¬ 
eration. It is probably the best single statement of the age- 
grade situation.^ In dealing with tests in the school subjects 
or influenced by the school training, both median age and time 
of examinaiton slioiikl be given. 

(2) In developing age norms either tests should be given 
to the entire school system, or a census of the entire system, 
at time of examination, .should be taken, The number of cases 
at each age outside of the group examined should be deter¬ 
mined and allowed for in the norms so far as x^ossible; such 
cases may be counted in at the top and bottom of the distri¬ 
bution if the number of such cases is small enough to make 
such procedure safe. In deteniiining whetlier the entire popu¬ 
lation at a given age is included, age 12 i.s probaljly the best 
reference point. Twelve year olds are very rarely found in 

® Statement in terms of per cent of retardation is, after all, a very 
clumsy statistical method. It requires in the first place reference to a 
standard time of the school year; September 1st is usually taker. 
And it, of course, requires that the census be taken at .some other 
standard time of the year. Limits and standard.^ of retardation and 
acceleration differ, normality may be panted only to children within 
a range varying from six months to three years. After all the central 
tendency is the important matter, but it is dealt with in tcriTi.s of 
number at one extreme. Why not simply median age and cither 
inter-quarlile range, ten and ninety percentiles, or something like tlial’ 
The whole situation naight be clariricd by some .such method, 
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high school, are usually not yet eliminated; and it may be 
considered reasonably sure that all the twelve year olds have 
already entered school, and that most of them have progressed 
far enough to be dealt with by the usual test, If possible, 
it is highly desirable that a test be given to the first three 
grades. Otherwise a perspective on the entire situation can¬ 
not be gained. 

(3) In developing norms for either age or grade, recogni¬ 
tion must be taken of the fact that different schools and neigh¬ 
borhoods differ markedly in age-grade distributions, in the 
ability of the children, and in a variety of other ways. Dif¬ 
ferences from school to school are likely to be much more 
striking than differences from one community to another, since 
segregation of different social classes in different districts of 
each community is frequent, but entire communities contain 
representatives of all classes. Standardization on the basis 
of entire small school systems is, therefore, much more satis¬ 
factory than standardization from the same number of chil¬ 
dren in two or three schools of a large city. In the latter 
case it is impossible to determine the influence of sociological 
selection upon the norms. 

(4) Our knowledge of standard performance is most woe¬ 
fully lacking for the adolescent group from fourteen on. In 
the present state of knowledge it is probably best not to attempt 
any standard norms, but simply to develop norms for school 
children, for working children, and so on. The greatest single 
need to-day in the field of mental tests is, perhaps, for the 
adequate determination of the total distribution of ability 
in adolescence. 


Summary 

The paper deals with the problem of obtaining unselected, 
representative, groups of cases for the determination of norms 
on the various types of tests. It is shown that 

1. Grade norms are highly unreliable because of differ¬ 
ences in amount of over-ageness, elimination, and age at start¬ 
ing to school, from one school and one school system to 
another, 

2. Unselected age groups are extremely difficult to obtain 
since (a) children of a given age may be found scattered over 
as much as eight grades, and (b) the exact nature of this 
grade distribution varies from school to school and com¬ 
munity to community. 
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3, It is pointed out that no satisfactory norms are available 
for ages above fourteen and that elimination from school, at 
these ages, varies markedly from one school to another. 

4. It is suggested that (a) in presenting grade norms median 
age per grade be invariably given, (b) in presenting age norms 
a complete age-grade census of the entire school or system 
should be obtained. The need for careful selection of groups 
for standardization, and the present inadequate knowledge of 
adolescent performance on mental tests, is also pointed out. 



MINOR STUDIES FROM THE PSYCHOLOGICAL LABORA¬ 
TORY OF INDIANA UNIVERSITY 

VIII, A Preliminary Investigatiom of General pHOONOsis—r. e., 
"General Ihtelugesce " 


By S. L. PRESSEY 


1. Problem and Materials. The present study could have been much 
better made in connection with some investigation in the field of 
business psychology; the greater variety and the more specific nature 
of the abilities required in any business concern, and the definite 
monetary criteria, would have made the analysis much more valuable, 
As it is, the materials used have to do with the public schools simply 
because these data were most available. The method was worked 
out, in the first place, with the notion that it might prove of value 
in personnel work, In a previous paper in this Journali data regard¬ 
ing the efficiency of a group scale of intelligence, in prognosticating 
failure and success in Junior High- School, were presented. In the 
discussion regarding this material it was suggested that extended 
investigation regarding the specificity of prognosis problems was much 
needed. That is, for the purpose of foretelling success or failure, in 
the endeavor to more closely co-ordinate work and ability, it is quite 
conceivable that different tests and methods may he necessary for 
long and for short time prognosis, or for prognosis in this or that 
line of work. It was urged that only by such investigations could a 
decision be reached regarding the validi^ of the "theory of general 
intelligence—that is, the theory that prognosis problems can be gen¬ 
eralized." The present brief study is, first of all, a preliminary essay 
at investigation of this problem; it is, in the second place, an attempt 
to relate, in a very concrete and direct fashion, test score and prac¬ 
tical criteria. 

The data consist of (a) the scores made two years ago by the 
children in a sixth grade Junior High School class, on a group scale 
of intelligence previously described in fliis Journal* and (b) the 
marks received by these same children at the end of the seventh grade, 
a year and a half later, A total of 115 children of this class took 
the examination and also had the complete school records required by 
the problem. And the very fundamental question is this: Can success 
and failure be foretold “in general" (ao to speak) by the scale-, or, 
are different tests needed according as one is trying to foretell suc¬ 
cess in different subjects? As subjects largely contrasted, in content, 
interest, and type of function which seems to be involved, arithmetic 
and English have been chosen for study. 

2. Rernlfr, It was desired to relate the tests and the criterion in 
as practical, and as concrete and intimate a fashion as possible. Under 

1 December, 1919. 

*Pressey, S. L, and L. W. A Group Point Scale for Measuring 
General Intelligence, 7, of Appl. Psychol,, Vol, II, 1910, pp. 250-269. 
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the circumstances, a scries oi correlation cocflicictits could hardly 
yield the information desiredit is tardily being realized that a corre¬ 
lation surface may be of an iiiBnitc variety of shapes, that for pur¬ 
poses of individual diagnosis summary of such tables in a coefficient 
may be of comparatively little value—that to many scatter-cliagrains a 
correlations formula is, essentially, inapplicable.^ It was, therefore, 
decided that relationship over the entire range of the distributions 
should not be studied, but only the relationship of the tests to failure 
—that is, relationship about the passing mark (75), The following 
table shows, in a simple and direct way, the efliciency of the scale 


Test Score 


Failed.. 

Passed. 

45 

50 

55 

i 

GO 

i 

G5 

70 75 

HO 

a 

4 

85 

3 

2 

90 95 

3 

5 6 

Total. 



1 

1 



7 

5 

8 6 





Test Score—C ontinued 




100 

rofi 

1(0 

IIS 

120 

125 laa 

13.'5 

140 

145 Total 


. 3 

3 


•A 

4 


1 


22 

Passed. 

. 9 

5 

ib 

19 

4 

B 4 

(') 

:i 

1 93 

Total. 

12 

A 

15 

21 

6 

R 4 

7 

3 

1 115 


in marking off those who have failed in two or more subjects, As 
will be seen, by iio means all the failures made poor scores on the 
scale, and by no means all those who made poor scores failed at this 
particular time. But in general the failures are to be found at tbc 


3 See for in,stance Kornhauser_, A, W., Meinc, F., and Ruml, Beards¬ 
ley. Two models showing the interrelation of several significant cor¬ 
relation variables. Psychological BttllclUt, Vol. XVI., 1919, pp, 230- 
235. Thurstone, L, L. Tests for College Entrance, Jouynal of Edu¬ 
cational Psychology, Vol. 1919, pp, 129-42. 

With regard to the writer’s data it may be said shortly that the 
distribution of marks was dillcrait for each subject; thus the range 
for arithmetic was very narrow (over half the marks were bctwcGii 
75 and BO), the distributions for English, SpelJiiig, and Geography were 
bi-modal, Spelling was skewed very markedly to the top and Geography 
as definitely toward the bottom. Evidently each teacher had her own 
standards, her own notions as to the proper allotment of marks; the 
teachers also presumably di/Fcied in the care with which they assigned 
their gradings, and differed also in their ideas as to what, after all, 
school marks should mean in the way of recognition of ability, reward 
for effort, hopefulness for a child'a future—and so on I But there is 
one point in the distribution about which a teacher must think seri¬ 
ously, about which she is much less left to her own devices—and that 
is the passing mark. Most important for the practical purposes of 
this study—it is the one point with reference to which the school 
takes practical action. The passing mark—75—is, therefore, taken as 
the reference point in the statistical work. 
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lower end of the distribution: in fact, the relationship is perhaps 
about as close as could be expected, all things considered. 

Such a table as the above exhibits, in a very obvious and direct 
fashion, the relationship between test and ^hool record. But for 
comparative purposes some way of summarizing such a table in a 
single index number is evidently necessary. The form of statement 
finally used was quite as simple and direct as the table from which it 
was obtained. If (it was argued) the scale had been, in this par¬ 
ticular instance, a perfect prognostic instrument then all the failures 
would have been at the bottom of the distribution of test scores; 
•the scale would have been 100% differential. As a matter of fact 
only 9 of the 22 failures are among the 22 who score lowest on the 
tests, That is, 9 out of the 22, or 41%, are "where they ought to 
be;’’ the scale is about 40% efficient, for this particular purpose, Such 
a statement (of "per cent where they ought to be”) is easily obtained, 
is largely independent of the number of failures dealt with, and would 
seem very well suited for the rough comparisons dealt with in the 
present paper.® And it may be said at once that the remaining data 
of the paper are presented in terms of these percentages. 

The above results will serve to indicate something as to the prog¬ 
nostic efficiency of the scale "in general'—that is, the efficiency in 
forecasting those who will fail in any t'wo subjects. But the writer 
was interested rather in efficiency along specific lines, in prognosti¬ 
cating failure in particular subjects. The failures in English (19 in 
all), and in arithmetic (22 Iti all) were, therefore, tabulated in the 
same fashion, and similar per cents of efficiency found. It appeared 
that the scale was 37% efficient so far as English was concerned, and 
22% efficient in setting off failures in arithmetic. 

However, for adequate details not only failures in each subject, but 
results on each test, should be considered. The following table shows 
the per cent of efficiency of each test, in differentiating failures in 
English, and in Arithmetic, 

Test 

123456789 10 

English. 5 31 26 11 21 26 16 37 37 26 

Arithmetic. 21 18 29 36 21 32 14 21 29 29 


*The complexity of the factors influencing a child's school record 
at a particular time must be constantly kept in mind. Thus of the 
19 cases who passed, but who scored below 100 points on the scale 
(the 25 percentile) 7 had failed of promotion during the previous year, 
and were progressing now only because they had recently repeated 
some of their school work. Two of those who failed, but who made 
a good score on the tests, are definitely known to have failed because 
of poor health. But, in general, there Is a positive relationship between 
test and school success and failure. 

®In comparing differential efficiency for different subjects the total 
distribution of test scores was first tabulated, once for all, from the 
card records. It was then only necessary, in studying cadi subject 
in turn, to retabulate only the scores of those failing. By marking in 
the failures with red pencil so that they stood out clearly—and by 
keeping the slide-rule handy—the whole method was extremely easy. 
Research " sketching" one might call it. 
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Apparently (if we may trust lliis table) the tests difTer distinctly 
in their ability to prognosticate success in these two subjects, And 
the practical question at once arises as to whether, by judicious selec¬ 
tion among these tests, a shorter scale, or “ differential unit," more 
efficient than the entire scale, might not be obtained. To make trial of 
the matter the four tests most diflcrenlial, for each subject, were selected, 
on the basis of the above tabic, and the tabulations from which it was 
derived.® And the scores made on these four tests by each child were 
added together, and the sums tabulated after exactly the same fashion 
as were the total scores on the entire examination, Thus the four 
most differential tests for failure in English were 2, 3, 8, and 9.'^ And 
Floyd T. made scores on these lour tests of 8, A, 8, and 11 points; 
his score on the English sub-scale was, then, 31 points. The tabulation 
showed this sub-scale to have a prognostic cfliciency of 47%, as 
compared with 37% for the entire ten tests of the total examination, 
in differentiating failure in English. And the arithmetic sub-scale 
(tests 4, 6, 9, and 10) gave 36% efficiency in differentiating failures 
in arithmetic, as compared with 22% for the whole scale. 

Apparently the tests of the entire scale differ distinctly in their 
prognostic value, There are, of course, two possible explanations. 
Either certain tests are efficient for one purpose but not for another; 
or, certain tests are of relatively slight value for any purpose. As 
has already appeared, the best tests for dealing with English arc by 
no means the best tests also for difFercntiating potential failures in 
mathematics. However, these sub-scales yield further information on 
this point. The arithmetic sub-scale is 32% differential of failures 
in English, and the English sub-scalc is only 15% differential of 
failures in arithmetic I That is, there is a reversal; tests may, ap¬ 
parently, be excellent for one purpose and poor for another. In an 
effort to emphasize this feature a sub-scalc demonstrating this was 
sought. Analysis by test showed tests 2 and 8 to be differential for 
English while poor for arithmetic, and tests 1 and 4 to be efficient 
for arithmetic but poor for English. A sub-scalc made by combining 
tests 1 and 4 gave 11% differential efficiency for English and 29% 

“Where tests were tied for fourth place, as is tj)c case with tests 
3, 6 and 10 for English, and tests 9 and 10 for arithmetic, choice was 
settled by inspection of the original labiilaticiis. 

'The nature of the tests is unimportant for the present discussicn; 
the point is only that tests appear to differ in their efficiency for 
different purposes—that the prognostic problems dealt with arc, to a 
certain extent at least, specific problems. For a detailed description 
of the tests the reader is referred to the original article presenting (he 
scale (see note 2), It may be said briefly that test 2 is "Logical 
Selection" (the blank presents such lists as "CHAIR—legs, rockers 
cushion, seat," and the children are told to' underline the two things 
a chair is never without); test 3 is made up of problems in practical 
arithmetic (mostly making change); test 8 is "Disarranged Sentences;" 
test 9 is "Practical Informalion.” The four tests of the arithmetic 
group (4, 6, 9, and 10) are opposites, "Word Completion,” "Practical 
Information," and analogies. There is little or no "superficial rele¬ 
vancy," in the tests of these two groups, to English and arithmetic; 
but the writer docs not believe that such relevancy is particularly 
important or to he expected. Tlic three tests which appear of rela¬ 
tively little prognostic value with reference to either subject arc the 
two memory tests and " Moral Discrimination.” 
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for arithmetic, And a sub-scale composed of tests 2 and 8 gave 38% 
for English—and 7%.for arithmetic. That is. tliere is a distinct 

^^S?h'a result, if it may be considered reasonably reliable.^ is surely 
important enough. It would indicate that prognosis problems were 
specific, not general. In so far as this may be true different tests 
and methods must be necessary for different problems. Tests of 
"general intelligence” can not, in such an event, be used if tlie most 
exact determination of ability (that is, the most exact prognosis) 
is desired; ability in English and ability in arithmetic, clerical ability 
and mechanical ability—each problem must be dealt with independently, 
and specifically studied. The point of view suggested is fundamentally 
different from that habitual at present; instead of dealing with specific 
problems on the basis of certain generalizations—dealing with them 
“in general "—each problem must be considered by itself, without any 
pre-suppositions. In. attempting to prognosticate ability in mathe¬ 
matics, in stenography, in salesmanship, one may go through the pro¬ 
cess of considering whether "general intelligence" or a “special 
ability" is the important factor, may try certain tests for measuring 
"intelligence," and in proportion as they deal efficiently with the 
problem declare that "intelligence" is a factor. Why not ask instead 
simply the one practical and direct question "What tests will deal 
most efficiently with this particular problem?" And consideration as 
to whether "general intelligence" or this or that specific ability is 
involved appears largely unimportant, and in the realm of the theoret¬ 
ical and academic. 

It is such a point of view that these results suggest. And it is 
3 point of view that is, if one is empirically minded, very stimulating, 

3. Discussion, ’ Certainly the result are not such as to warrant any 
conclusion in the matter I But it should be kept in mind, in con¬ 
sidering the great mass of experimentation, observation, and theory 
which forms the basis for current ideas regarding the dominant im¬ 
portance of " general intelligence," that there are certain constant 
errors which operate greatly to increase the apparent importance of 
the "common factor" In spite of the best intentions, judges tend to 
overestimate the similarity of an iadividual's abilities along different 
lines.® In spite of the best efforts of the test builders, it is still hardly 
possible to “ test" much besides various types of controlled association 
of the verbal type, with any satisfactorinessfor any adequate sampling 
of the total richness of human activities the tests are still pitifully 


®lt is not reasonably reliable—of coUrsel ^oth method and data 
are painfully inadequate to the importance of the exceedingly funda¬ 
mental and difficult problem dealt with,—a problem which can hardly, 
in any case, be "solved," but resolution of which can come only as the 
result of a multitude of investigations, from a variety of standpoints, 
and after a period of years- The present study is simply a bit of 
exploratory research, and trial of methods. But as such it would seem 
of some interest, and suggestive value. The writer has a notion that 
in dealing with such large and extensive problems, a large number of 
such smaller studies, attacking from many angles—a campaign of 
attrition one might call it—are likely to be much more fruitful than 
a few elaborate and laborious investigations. 

® See Thorndike, E. L« A Constant Error in Psychological Ratings. 
Journal of Applied. Psychology, Vol. 4, 1920, pp. 25-29; also Kelley, 
T. L. Educational Guidance. Teachers College, 1916. 
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inadequate, High infcrrclation Ijctwccn Icsts can hardly, ihen he 
used as evidence for close correlation between all lynes of nhilitv 
In spite of the great broaflcniiig of the iniblic scliool curriculum in 
recent years, progress in school is still coiuiliioiicd almost wholly hv 
ability in the academic, bookish subjects; "general" ability as it 
appears in school iiiay be simply ihc funciioniiiK. with different ma 
terials, of a relatively special ability. It should also he pointed out 
that, while it may lie convenient for practical purposes to sum Hip 
results of a senes tn lesis iniu a .single l•alI^lg, to averatre scliool 
marks, or employers eslnnalcs or otherwjse develop .syntlicdic state- 
ments as to an individual s alHlily, such iiivcsligaiions are likelv to 
yield just what is put iii by the procediire-ccriain vague Lreneral 
facts, whicli may very well uliscure the ccincreic. .simcific details we 

are most in need of. Ihc general factor may he ii,e ali-imporlant 

faclor. But wc are surely as yet m no position to lie dogmatic abn 
it. Practical considerations may make it advi.sahlc to proceed iinon 
that hypothesis, Meauwliilc, rnlical investigation of the concent of 
“general inlclligciicc is surely much needed. It is as a bit of sup 
gestive research along such lines that the present paper is intended 

A word remains to be said regarding the method which was ein^ 
ployed, for relating lest.s and school record. It has obvious faults— 
faults so obvious that they liarilly need nicnticn.^^ It is simiilv an 

efforl, in keeping with Hie iiindaineiital idea of the study to deal 

with things 111 the very most concrete and .specific manner’possible 
The parliciilar mcilmd is oi little iniporianre. lint methods of this 
sort, which permit study of rclaliimsliips in a very simple direct and 
specific way. would seem capable of rendering di.stinci service in ’deal 
ing with many iirolilems of applied psychology. 

.S'liiiJMinry 

The paper deals wiili the scores made by a large Junior High .School 
class, on certain tests of iiilelligeiice. and with llip marks nlitaiiicd hv 
these children ovi'i a year later. Tim ipie-stion is as to the relative 
merits of these tests, m loreielliiig what marks these children would 
receive. It was fomid lliat: 

(1) The tests «lilT.-re*l distmrily in ilu-ir prognostic efficiency Bv 

careful selection and rombiiiation four tests wen; found which were 
more elTicicnt than the oniirc ten tests ni the examiiiaiioii iiseil for 
(he nur|io.ses .studied. ' 

(2) Certain tests appeared very eftirieiil for certain purposes but 
poor for Ollier purimscs. Ihe f-iir-u-st .liffereniial units showed (hi.s 
same specific cfliciency: dllTereiit tesis a|.p<arerl lobe re<niired for fore'- 
Id iiig failure in aiiihmeti.-. and English. Certain groups of icsts 
exhibiting this specific prugiinsis i,> a more marked flegrce were 
also found. 

It is urged lli.al invesiiK.iiioii regarding the speeificiiv of prognosis 
problems is much needed. ' 

'“It i.s, parhcularl.v. a m.-ih..d which c.alls no' a much 
of case.s, if the l.mlmgs he reliable. It is ilie writer’s Judg- 

menl, from Inal ol the im-llu-.l m a varniy of way.s and mi a variety 
of data, that it is lui.rc; rthalde lhan niiglii he siipiiosiMl. Ilowevcr as 
an example of an aiial..K.iii>. iii.ili...| yi-hliiii: a more .snil)l<: refill see 
Prcsscy, .S. 1., flic I taelKal ’ I-i{|i-ifnrv " oi a Gn.uii Scale (»f liiiclli- 
Bcncc, /rninm/ „/ V..I. III. ]'i|0, ort-Si) Hr 

Suggcstrrmc; i-cgar-hiig I'l.Tli.iiM.,nr\ • Xf.-ihn, ,,f Criiicil 
Scorc'.s,”’y.uomif , / : /'v.J,Ii.-cc,„I,. r, 1 'mV 





MINOR STUDIES FROM THE PSYCHOLOGICAL LABORA¬ 
TORY OF INDIANA UNIVERSITY 

IX, Further Data with Regard to Sex Differences 


By S, L, Pressey aud L. W. Pressev 


I. Problem ond Mafei'hU, In a previous paperi by one of tlic 
writers, data were presented with regard to sex diflerences in central 
tendency and variability, as they appeared on a scale of general intelli¬ 
gence, It was concluded that (1) the girls showed a very slight, 
though constant, superiority in central tendency when score on the 
entire examination was considered; on the individual tests they showed 
superiority in controlled association and memory—on 8 out of the 10 
tests. The boys showed a marked superiority in arithmetic and were 
slightly better than the girls in general information. (2) The boys 
showed a slightly greater range—which was also cortstant for all 
reliable ages. Analysis by test showed a similarly greater range for 
the boys on seven of the ten tests; three tests showed little difference, 
but in no case was there greater variability .'Among the girls. The 
present paper reports'briefly certain further da!t4 with regard to sex 
dlEerences on various types o( examination. 

Three groups of data are dealt with: (a) Results from 1,408 chil¬ 
dren 6, 7 and 8 years of age, tested with the Primer Scale.* (b) 
Results from 787 children 12 and 13 years of age, tested with the 
Cros8-Out Tests.® (c) Results from 101 college students, tested with 
a series of tests intended for the “investigation of the emotions.”^ 
The reports on these three sets of data will be taken up Ln order. 

II. Results, (a) The Primer Scale has been described in full else¬ 
where; in this connection it need only be said that it is a brief group 
scale for measuririg general intelligence, consisting of four tests not 
involving ability to read or write, for use with children in the first 


jPressey, L, W. '“Sex Differences Shown by 2,544 School Children 
on a Group Scale of Intelligence, with Special Reference to Variabil¬ 
ity." Journal of Applied Psychology, Vol. 2, 1918, pp. 323-340. 

* Pressey, L, W, "A Brief Group Scale of Intelligence for Use in 
the first Three Grades," Journal of BJucaliomI PsYchohgy. Vol. 10, 
1919, pp. 297-308. 

® Pressey, S. L, "A Brief Group Scale of Intelligence for Use in 
School Surveys," journal of Educaiional Psychology, Vol. 11, 1920, 
pp. 89-100. 

^Pressey, S. L,, arid Chambefa 0. R. “First Revision of a Group 
Scale Designed for Investigating the Emotions. Journal of Applied 
Psychology, Vol, 4, 1920, pp. 97-104. 
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llirce grades,® In recent surveys all the children in Ihc first three 
grades of five cities have been examined—a total of 1,-108 cases of 
which <598 were boys and 7l0 were girls. The results for 7 and fi 
hare been tabulated by sex. The six year group had to be dropped 
from the study because three of the five cities liad yearly proinotiojis 
only: the result was that in these three cities only about 607o of the 
six year olds were in school at the lime of the surveys, and of,these 
a majority were boys—tlie tendency seeming to be to keep the girls 
out of school and at linme somcwlial lunger. A somewhat analogous 
dillicully was encountered jii obtaining an iiiisclccted eight year old 
group; there were some children of this age wlio were in the fourth 
grade, and so not testcfl with this scale. However, ilierc were only 
a few of these cases (H in all, 7 hoy.s and 1 girl) in the five cities 
taken together. And .since there were so few accelerates, it seemed 
safe to assume that only the very brightest children received double 
promotions; these 8 children have, therefore, been counted in as 
above the 90 percentile for their age. With tills interpolation, the 
data for ages seven and eight would seem fairly satisfactory, 

The results, a.s regards cciUrat tendency, may be summarized very 
shortly. The girls show a slight superiority; of the children who 
compose the upper half of the entire distribution for these two ages, 
53^ are girls and ‘17% boys. Findings as regards variability seem 
to indicate a greater range for the boys. Two inetltods were used. 
The first nictliod required simply the examination of tlie highest and 
lowest 10, 3 and 1 per cents of the entire distributions to determine 
the composition of the extremes as regards sex. The results appear 
below; the two ages have been combined and the numbers thrown 
into per cent. It will be seen that the boys predominate in the 
extremes; and the further out into the extremes the iiivcstigntioii is 
carried the more the boys arc in the majority. 




TABLE I 




B. 

G. 


B, 

G. 

Highest lOper cent... 

. 51 

49 

Lowe.st 10percent.. 

. 55 

45 

Highest Spcrcent... 

. 81 

19 

Ixiwcst 8 per cent.. 

69 

31 

Highest 1 per cent.., 

, 100 

0 

Lowest 1 per cent., 

, 100 

0 


®See reference note 2 above, or Prcs.scy, S. L. and L, W, '' Cross- 
out Tests, wi‘h Suggestions as to a Group Scale of the Emotions,” 
Journal of Apifluul Psychology}, Vol. 3, IDIQ, pp. L18-150. The first 
test consists of group.s of dots, each group of dots making a pattern; 
there is. however, one dot In each group which is outside of or .spoils 
the pattern—this dot the clifldren arc to cross out. Tlie second test 
is made up of squares, each square containing two objects which arc 
similar, in some important way, and one object which i.s diiTercjit from 
the other two; this diflerent thing the children arc to cross out. The 
third test shows at the top of the page four forms—a triangle, a square, 
a cross, and a circle. lielow arc squares or *’ boxes " containing 
"blocks" wliicli arc to be fitted into the four places at the top of llie 
page; but in each ‘'box” there is one piece wliich will not fit in— 
and this extra piece is to be crossetl out- The last test shows pieiiircs 
in each of which ilierc is something wrong—this wrong pari is to he 
crossed out, 
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The second method far invesligaliiig variabHily was even more 
simple, It consisted of simply examinine the distributions of scores 
for each one of the five cities separately for ages seven and eight, 
in order to determine whether, in each distribution, a boy or a girl 
scored highest and lowest. There were, thus, ten cases of highest 
score (one for each of the two ages in each of the five cities) .iiid a 
similar number of lowest scores. Of the 10 highest cases, every one 
was a boy; there was not a single girl at either age in any one of 
the five cities who made tiae highest score for her age, Of the 
10 lowest cases, 6 were boys and 4 were girls. 

(b) Results from three cities where complete surveys were made 
were included in the consideration of sex differences found with the 
Cross-Oat Tests. After very careful consideration it was decided to 
limit the study to ages twelve and thirteen; because of the influence 
of school selection it was inipossible to obtain reasonably unselectcd 
groups [or any other age. As it was, a few of the twelve-year-olds 
and one or two of the thirteen-year-olds were still in the first three 
grades, where the test could not be given on account of literacy (over 
10% of the eleven-year-olds were in the first three grades, while many 
of the fourteen-year children had left school). Since the tests in¬ 
cluded the High School, the upper ends of the twelve and thirteen 
year distributions were tested. So the only children of these ages 
who were missed were & retards below the fourth grade (six boys 
and two girls); these have been counted in as being in the lowest 
three per cent for their age. Of the total 787 cases, 387 were hoys 
and 400 were girls, 

The tesults as regards differences ii\ central tendency agree with 
those found with the Primer Scale. Taking all three cities together, 
there were 46% boys and 54% girls scoring in the upper half of 
the distributions. In City A die upper half of the distribution was 
composed of 45% boys; in City B, 47% boys; and in City C, 47% boys. 

The findings as regards variability are, however, very indeterminate. 
Again, the highest and lowest 10, 3 and 1 percents of the entire 
distributions were examined in order to determine the composition 
of these extremes as regards sex. The results are given below; again 
the two ages have been combined and the figures thrown into percents. 


TABLE 11 


Highest 10 per cent. 

Highest 3 per cent... 

Highest 1 per cent.. 

Lowest 10 per cent... 

Lowest 3 per cent... 

Lowest 1 per cent (not all of the eight children below the 4th 
grade would score in the lowest 1%; therefore it could not 
be reckoned,) 


B, 

48 

43 

50 

60 

67 


G. 

52 

57 

50 

40 

33 


The width of the distributions for the two sexes is about the same; 
the table indicates little except the effect tfiat would be expected in 
the extremes from the fact that the girls’ central tendency is higher.® 

® The scores from two of these three cities were analysed by test. 
The results are by no means consistent from one city to the other. 
Two facts, however, stand out rather sharply. On the first test, for 
both cities, the girls show a wider range; of the children .scoring 
in the highest l(J per cent, 56% in City A ■and 63% in City B are 
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(c) A group of five Icsls ''designed for Ihe investigation of the 
emolioiis’’ has already been described in a previous aumber of this 
Journal. (See Note 4.) Results from lOl college students, 52 
girls and 49 men (students in a course in Abnormal Psychology and 
a course in Domestic Science, for the most part Juniors and Seniors), 
were analy 2 ed by .sex^ and may be suiiiinariacd briefly. 

Test 1 consists of five li.sls, each of five words; these words are, for 
the most part, of emotional content,—such words as tremble, street¬ 
walker, rival, ugly, insult. The .subjects were told to read through 
Ihe lists and cross out cvcrylhinp that was unpleasant to tlieni. It 
was found that 55'Jt> of the girls crossed out more words than the 
median boy. The siibjecis were then told to go through the lists 
again and draw a line around the most unpleasant word in each list. 
In scoring these responses, ilie word chosen as most unpleasant by 
the greatest luimbcr was considered Ihe modal word for that list, and 
the score of each person consisted of the number of lines in which 
he chose some other than the modal word as must unpleasant—that 
is, the number of times he deviated from ihe modal choice of the 
group. (In some ]im.'.s the men considered one word as most un¬ 
pleasant while the girls chose another; on these cases both words 
were considered modal), ft was found that qo% of the girls deviated 
more than did the nicdtan man." 

In another lest, in which the subjects were required to read through 
25 lists of mor.'il terms (sucli as insulting, quarreling, mislead, hurt¬ 
ing, carefulness), and cro.S5 out the worst thing in each list, 22% of 
the girls deviated from the modal choice more than the median man. 
Similarly, in going through the same lists again and sciccling the 
most common sin, 2(t'/c of (he girls deviated more than the median man, 

III a third lest, in which the subjects were required to read through 
25 lists such as I’OOT—leaf, slocking, tennis, spieler, kick, and cross 
out the word in small frticr.s most closely connected in their mind with 


girls; of those scoring in the lowest 10 per cent, 69%i in City A and 
61% in City 11 arc girls. The other fact is a similarly greater range 
for the boys on the third lest. Of those scoring in the highest 10 

per cent, 59% in City A and 67% in City C were boys; of those in 

the lowest 10 per cent, 56% in City A and 58% in City D were boys. 

It should be said at once, however, with regard to this last result, 

that on a test somewhat similar to (his (another erithnictic test) 
used in the previous study referred to in Note I, the range for the 
boys and the girls was identical, although the central tendencies were, 
in both cases, higher for the l)oy,s. Test 1, it should be mentioned, 
is a form of Di,sarranged Scntcnce-s; Test II is a te.st of practical 
iniormation ; Test III is a form of number progression; and Test IV 
essentially a vocabulary lest. On tests two and four there appeared 
to be little dilTcrcncc in variability, or in central tendency. 

’The tabulatioji.s were made by Mr. O. R. CJiambers, to whom the 
writers wish to express their obligations, 

Ht should also be mentioned that the words of the test were 
divided into four classes according as they were unplcasani because 
(hey appealed to fear, disgust, sex or self-feeling. Half again more 
sex word.s were selected liy the girls than by the men as most un¬ 
pleasant, while half again more hoys than girls selected the self- 
feeling words as mo,si unidcasani. The men exceeded Ibe women in 
the selection of (car words. 
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the word in capitals at the beginning of the list, only 27% of the girls 
showed idiosyncrasy greater than the median man. 

These results are, of course, from only a few selected, adult cases, 
and are results on only three tests." They are included in this report 
because of certain important bearings such findings have^ the writers 
believe, upon the interpretation of results obtained with tests of in¬ 
telligence. 

3. Di'jcHss-fon. The above materials surely make up an odd collection 
of results, from which it would hardly seem possible to draw any very 
definite conclusions! It seems fairly clear that on the usual scale for 
measuring "general intelligence" girls average slightly better than 
boys. The differences ar^ however, so slight as to be essentially 
negligible from any practical point of view. Ih fact, the slight su¬ 
periority of the girls may very well be due simply to a preponderance 
of tests of a literary nature, in such scales, as they are usually made 
up. The boys show superiority on other types of tests—as has well 
been demonstrated by use of the army tests in the universities, In 
fact, the writers would be willing to contract to build a group scale of 
" intelligence " in which the boys' would excell. Or, perhaps the funda¬ 
mental fact in this superiority of the girls is dependent in part upon 
a greater docility or upon a relatively greater interest in indoor tasks. 
Or, the difference may be connected with differences in physiological 
growth rate—one might enumerate almost any number of possible 
causes, but surely with no great profit. The one fundamental and all- 
important fact about these differwees in central tendency is, as Thorn¬ 
dike saysji® " their small amount.” 

As regards variability the situation is much more complex. The 
findings obtained by the Primer Scale are essentially in accordance 
with the results obtained previously by one of the writers (see note 1). 
The findings with the cross-out tests fail to support these conclusions, 
It may be that the more narrow distribution of scores given by these 
tests does not give room for the differences to show themselves, There 
is no good reason that the writers can see, however, for supposing 
this; the amount of it is that the total findings arc not consistent with 
each other, Certain considerations with regard to what positive find¬ 
ings there are, indicative of greater variability among tlie boys, remain, 
however, to be mentioned. 

It should be pointed out, first of all, that the positive findings, even 
if they be accepted at their face value as indicative of fundamental 
greater variability in mental calibre among hoys and men, do not indi¬ 
cate differences in variability sufficient to warrant any practical action 
in educational policy, in business, politics, or elsewhere. It should 
also be made clear that the differences between the most brilliant boy 
and the most brilliant girl are so slight as to make it altogether un¬ 
warrantable in particular instances to discriminate toward or against 
either sex, The positive findings, even with the most that can be 
made of them, have no more than a theoretical and general interest. 

But there are a number of other entirdy plausible explanations 
which can be given for the positive findings as regards variability— 
explanations which do not presuppose any difference in the distribu¬ 
tion of intelligence, Three such explanations seem lo the writers 
particularly worth mention, 

“ Two other tests were given (sec the original paper, note 4) but 
the results yielded were of doubtful reliability. 

^"Thorndike, Educational Psychology, Voj, 3, 1914. 
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(a) It iias already been pointed out that tbc liighcr average of ihe 

girls, in total scales used, may be due simply lo ilic nature 

ol ihc tests making up these scales—lo a more or less chance of 
selection of tests on which the girls did belter; and the writers have 
ventured the asscTliuii that it would be eiilircly possible lo formulate 
a scale showing a similar sUgbt auperioriiy for the boys. There is a 
little evidence to suggest llial, in analogous fasliion, comparative varia¬ 
bility may be coiuliiioned by llic nature of the tests (as with tests I 
and III of the Ctosk-omi .Seale). 

(b) It must also be cmidiasized that selective iitflncnccs, of an 
extremely subtle ami iiervasivc kind, operate to make it exceedingly 
diinculi to obtain sex groups so thorougiily inisclectcd as to make 
suitable material for ibe study of nice differences in variability. Tlie 
difficulties in Ibis cttniUTiioii riicnunlercd in the present study may 
serve as illuslralion.** The possible iinptyrlaiicc of differences in age 
of entering remains, however, to he pointed out. In ccrlaln of the 
s/ifetirs exan»inct| the flilTerence was marked; thus in City G, there 
were 63 boy.s six years of age and only -16 girls. If we may suppose 
that the boy.s, as a result of circumstances, tend to enter school earlier, 
but for (lie most (tart <lnip back; and if we ma}' .suppose die tests to 
a slight degree alTcclfd by H'honl training, we cviilciUly have a very 
pretty explanation for greater variability on the part of the boys. 
They have been in school longer, the brightest boys are fuilhcr along 
than the briglilesi girls; but. for Ihe most part, titcy arc less devel¬ 
oped, or Ic.ss inierr.sU'd in .sebno) work, and the (hillc.st onc.s soon drop 
bchltul the ilullcst girls. This explanation is, tlie writers feel, of 
some little inicrost. 

(c) it should, finally, be emphasized that (hero arc very marked 
di^crciiccs bciwcen Uic sexes in cinolinnal attitudes and interests— 
dilTerenccs which arc the most marked nndings in previous studies, 
and which have receivi'd inlorcsling coiirirmalinii in the emotional test 
daU just presented, .Huch iliffcrcnces may be the result of differences 
in instinciivc cqtiipiiieiil. 'J‘)iey arc surely aKso. in no sin,ill part, due 
to social influences. It would seem not at all unlikely that sucii factors 
nvght have their iiidnciicc vipon results yielded by tests of "intelli¬ 
gence." VVhctlier tltcy ctmid operate to affect varialnUly may he a 
question; but several ways are conceivable in which they might bring 
about such a result. In considering any differences between tlie sexe.s, 
emotional elements wnnld seem deserving of first consideration. 

Well—surely no very dcfiniic conclusions arc possible I In fact, the 
writers have cuine lo fee) iliat the lest instrnnicnls arc hardly at 
present developed to the nicety required for .satisfactory study of sex 
differences, so far at least a.s variability is concerned. And they have 
largely lost interest in the [iroblcm. They arc, in fact, rather inclined 
lo feel that it mighl he wi.scr to .speak of tests of iniclligcncc as tests 
of general prognosis, as i.s suggested in the accompanying study, with¬ 
out attempting to decide as lo just what factors may coiitrihnte to tlie 
prognostic indication. It ilien at once appears that .such tests arc hardly 
suited for invesligalion of this problem of sex differences in mental 
endowment. 


"See also Pj'C.ssoy, .S, I.. "The Problem of ihe Unseli'Cted Grou]) 
in the Slandardizaliuii of Tc.his," Journal of .Ipf'licd !’syi-li<ilo<iy. 
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PRESSEY AND PRESSEY 


Summary 

The article summarizes certain data with regard to sex differences 
in mental and emotional traits, as determined by various tests, It was 
found that! 

], Results with the Primer Scale show a slight superiority hi central 
tendency for the girls and slightly greater range for the boys. 

2. Results with the Cross-out Tests show a slightly superior central 
tendency lor girls; the findings with regard to variability are inde¬ 
terminate, 

3. Results with a series of tests "designed for the investigation of 
the emotions" show definite sex differences among college students 
in likes and dislikes, moral judgments and emotional associates, 

4. It is concluded (a) that sucli sex differences in intelligence arc 
of no practical importance, (b) that it is hardly possible at present 
to investigate these differences with any degree of exactness because 
of the difficulty in calculating the influence of (1) the subject-matter 
of the test, (2) selective factors, and (3) emotional factors, probably 
of environmental origin. 



A NEW JOURNAL OF PRACTICAL PSYCHOLOGY 
And a Traiislaliort of Its Iniroduclory Ankle 


IJy IlENny C, Link 


In Oclobcr, 1919, Gerniany saw lUc aiHwaranc.c oi a new monthly 
journal devoted to the ftcl4 ol iiraclical psychology. This journal, 
entillcd “Praklisdic Psychnlogie/' is cililert b)’ J)r, W. Moodc and 
Dr, C. Piorkuwski (Hcrliii W. 30, Luiliioldsir. 1^). The former is a 
teacher al the Charlaitenliirr^^ Unii’crsily and is carrying on extensive 
experiments with tool aiiiircniiccs. The contents of lire first two 
numbers of this joiinml have already been bn'clly reviewed by the 
writer in the I'sychohniatl HuUetin for Oclobcr. 

In introducing lliis journal, the editors say in part: 

‘‘Praktisclic Psychologic” Is the first monifily paper which is 
comiucted in lire interests of the entire field of applied or practical 
psychology. It will concern itself chiefly witli indvisirial psychology 
and cxpcrimcntfll pedagogy, Unt also with medical, legal and social 
psychology as well us with experimental csihctic.s. Tlie chief emphasis 
of ihe publication, jiowcvcr, will be o|Kjn Industrial Psychology, 

The field of iiulu.strial psychology includes in the first place: 

"Vocational aplitndcs and vocadoiinl guidance. The tremendous 
importance to the new state of this particular subject is indicated by 
die appropriation for vocattonal guidance made joiiiily on March 19, 
1919, by llic ministry of industry aitil commerce, ilic ministry of the 
interior, of education and of aKricuUurc. Vocational guidance is 
(hereby made a duly of the local roinmunily, and ilio careful consid' 
eralion of bodily and menial npliUidcs is strictly enjoined. We shall 
discuss impartially all stalintical and experimental studies which con¬ 
tribute to the knowledge of the necessary facts regarding a particular 
vocation," 

"A second important aspect of Industrial Psychology is the reor¬ 
ganization along more rational liiic.s of the apprcnliccsiiip system and 
ol working nicthod.s. T hese .subjects will be iboronglily discussed as 
a part of Industrial Psychology. Above all we shall licre dc.scribc the 
steps by which operations al n machine or al a desk arc to he im¬ 
proved in the direction of increased comfort or decreased fatigue. 

"In addition to actual operations we shall also thorouglily consider 
questions of external and internal organization in llic light of psycho¬ 
logical technique. Tile most effective luclhods of instruction will 
receive our particular allenlion.'' 

The first article in new journal is an elofiucnt exposition ol the 
itgnificaiicc of the new science for the future of Germany. It was 
Ibought that American psychologists would be interested in this point 
of view and in the .scope of science as it is here described. For this 
reason, pertnis.sion was ohtaiiiccl from Dr f,i. .Sclilessingcr, the writer, 
and from the editors, to Ir.’m.slatc aiul publish the ;\rticlc in ihi.s country. 

flf) 
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Vocational Guidance and Psycho-Technics 

Professor Inc G. Schlessingeb at Cliailottciiburg 

Tile most powerful stimulus of the German revolution is the recogni¬ 
tion of the fact that the destinies of the world arc determined not by 
matter and its organization, not by force and its application (in these 
respects the utmost was accomplished during the war) but by the human 
being in the capacity of manager or executive, leader or subordinate, 
The exaggerated mechanization of human beings, compulsory labor, the 
censorship, excessive discipline, led inevitably to rebellion, to the violent 
breaking of the chains which bound a newly unified people, Man is not 
a machine. There is no money equivalent for personal sacrifice. 
Therefore, our workers today are struggling not for higher wages, 
merely, but for moral values. Above all, they wish to elevate them¬ 
selves from the degraded level of the fourth class to the level of 
equal rights and privileges. “We workers wish to share in knowledge 
(mitwlssen) and to cooperate (mitwirken) where practicable, in man¬ 
agement, Wages, however, shall be based on accomplishment.” 

"Granted that the humanity and the personal dignity of man now 
hold the center of attention, and that man-hours and man-units are 
no longer to be treated as commodities, the supreme problem before 
us is to place the best man always in the best position—in the trade 
school, where the apprentice develops, in industry where laborer and 
executive are employed, in the development department where ma¬ 
chines are invented and prepared for the manufacturer, in the execu¬ 
tive department to which the threads of industry lead and in which 
they must be kept free from entanglements and undue tension, To 
find the right man and place him in the right position is today more 
than ever, the supreme problem in our broken down Fatherland, for 
although raw materials are scarce, leaders are even more scarce, 

While we are waiting for a Messiah, some conspicuous leader who 
will help us out of our deep distress, we cannot remain idle, We must 
give rein to our old German virtue, "Strenuous and systematic work." 
We must exert ourselves to find or create the means which will infuse 
new strength into Germany’s mainstay, namely, its powerful Industry. 
We must cooperate in the laying of that human foundation without 
which our recovery is impossible. 

Enthusiasm and inclination are the conditions of great deeds I But 
who can work energetically and cheerfully if lie has chosen the wrong 
vocation? Who can help a youth, when he leaves school and lacks a 
well-based preference for a particular calling—an occurrence which is 
all too frequent—to find the right path? The father is onesidedly 
absorbed in his own occupation, with which he himself is frequently 
dissatisfied. The teacher usually knows only superficially the require¬ 
ments of the various activities about which he is called upon to advise 
his pupil. He can advise him only morally and ethically, The physi¬ 
cian can, on the basis of a few physical examinations, only inform his 
patient whether hia health and strength will suffice for a particular 
vocation. 

Therefore, we are confronted at this critical point by a gap, which, 
if not bridged, will have the most serious results on the working 
effectiveness of the nation. 

The choice of vocation and thorough vocational training are bound 
up with effective and practical vocational guidance. The latter re¬ 
quires experts whose knowledge must be accompanied not only by 
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honest intentions and a warm heart (who can call himself a vocational 
counsellor without these?) but by a mastery of the entire technique 
which enables us to illuminate the mental makeup of the person to 
be advised. Though many of the mental activities of man are only 
mechanical, how fallacious it is to rate copying, counting, and figuring 
higher, mentally, than driving an automobile, cutting a micrometer 
screw, or filing a fine piece of work. These arc only different mental 
activities, At one kind of work hands remain clean and collars white, 
but the degree of concentration, the feeling of responsibility are in no 
way more intense and arc only necessary to a greater extent, 

The science of management, therefore, rightly gives first emphasis 
to the proper selection of men. It always begins—if it is to be suc¬ 
cessful in the central office of an industry, among the so-called brain 
workers. It appoints these, and not only lays out the plan of opera¬ 
tion, but above all designates those who are to execute it. It ends 
only in the shop with the actual process of manufacturing. Its influ¬ 
ence is strongest and most penetrating from the top down rather than 
in the reverse direction. With a practical man one can talk business. 
Every word starts a chain of Aought, releases a scries of experiences, 
with which it is easy to tie up new ideas. To convince a routine 
encrusted, academic bookworm of the value of new methods is, as 
experience tells us, much more difficult because the powerful mental 
influence which actual work in a shop exerts is missing and must be 
replaced by abstract education through the spoken word and the use 
of general concepts, 

Therefore, the content of vocational guidance—Psychotechiiics—is 
based for the present, above rU things, on the discovery of the mental 
abilities of the apprentice. A technical procedure is required in order 
to analyze the inherited tendencies of an individual though not to 
explore his soul. The word “Psycho" is, to be sure, misleading; our 
concern is not at all with the “.soul” or with morals or ethics, or 
with a man’s will-power; the latter can only be discovered through 
personal association, and for this tlic teacher in school is the proper 
person. From the standpoint of the practical psychologist we arc 
concerned only with the ostcitsibly spiritual. Those objective mani¬ 
festations which the individual himself can verify and which will 
offend no mar. For instance, whether an arm is strong or weak, an 
eye far or near-sighted or color-blind; whether the mathematical sense 
is crippled, the memory weak, or the susceptibility to fatigue marked— 
these are determinable facts which will never embarrass an individual, 
We arc concerned not with demotion but with proper classification. 
For the presence of a number of these attributes, partly physical, 
partly mental, is indispensable to the successful exercise of a particu¬ 
lar vocation. The blacksmith needs a strong hand, the locomotive 
engineer must be able to distinguish colors, the piano tuner must have 
a musical ear, a librarian a good memory, as must also a writer, 
Tile pilot of a boat, an airship, a motorcar, must not become easily 
exhausted. 

The dilettante scientist is therefore unable to study psycho-technics 
as an abstract science. He must start with a particular vocation, the 
elementary requirements of which he must carefully gather, sift, and 
analyze belore he can undertake to apply his tests with any chance of 
success. This preparation the psycho-technical procedure prescribes 
as indispensable, Then follows the search for apparatus with which 
to measure these innate qualities, and finally the construction of the 
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apparatus. The apparatus can be borrowed from ihc immediate re¬ 
quirements of the vocation itself—for example, a micrometer as a 
test of the sense of touch; it may, however, he quite independent o[ 
such a connection, as, for example, the tremometer for measuring 
tremor in core-makers, the tachistoscopc for street-car motonnen, etc, 
Slowly, but surely, the close cooperation between engineer and busi¬ 
ness psychologist which has now been achieved is developing a pro¬ 
cedure which will apply equally to all vocations, and which will vary 
only as to the apparatus required by the different occupations. The 
machine designer and the mason, the automobile driver and telephone 
operator have more mental activities in coinjuon than the superlicial 
observer generallj; tliiiiks. And yet the entire program of llic indus¬ 
trial psychologist is far removed from any attempt to expose the soul, 
a belief with which ignorant opponents try to irlgblen the workers, 

One who has seen the many hundreds of fourteen to sixteen- 
year-old apprentices at the Charlottenburg Technical High School, 
working cheerfully and even enthusiastically in the vocational experi¬ 
ments being conducted there for machine tool and sl\op managemeiu 
work, a group which Dr. Moede is handling, one who has lived through 
the tragic circumstances which called attention to Ihe iteccssiLy tor 
such experiments, will be convinced that we are on the right track, 
that we are indeed bridging the gap which has hitherto separated 
the school life from the vocational calling, and that wc will open our 
accounts on a fresh page when parental home and the school, medicine 
and industrial psychology, cooperate toward a common end. 

Neither science nor experience are the determining factors nor arc 
we primarily concerned with calculations, inventions, or experiments, 
Our chief concern is the full, unhindered development of inherited 
qualities, in short, with the really best development of every single 
being. Only in this fashion can we convert workers, from the maiiiial 
laborer to the general manager, into skilled vfovkcrs. And only thus 
can we attain the high level ol humanity from which the longed for 
leader will finally arise. 



BOOK REVIEWS 


I, CHOsnv CuAi'MAN. Trade Tcsis. Henry IIoU and Company, New 
York, 1921, p. 435. 

As is indicfilcd by ils siiblillc, this book by Professor Chapman 
conslilutos A niniuinl on '' I bo Sciciitillc Measurement of Trade Pro- 
ficicncyi” .’ind iinswers the general question, "What is a trade test?" 

The chapter heiidiiiRs which follow arc indicative of the scope and 
character of the work: The Constniciion of the Oral Trade Test; 
Administration and Scope of the Oral Trade Test; The Picture Trade 
Test Method; Tlio Construction of a Performance Trade Test; The 
Written Group Test Method; The Analogy between the Army and the 
Industrial EmpioymeiU Problem; Problem of Occupational Analysis; 
Wliat the Trade Test is Not; The Use of the Various Types of Trade 
i'ests: The Adaptation of Trade Test Methods to the Training of 
Employees; the Installation of Trade Tests; and Some Further Appli¬ 
cations of Trade Test Methods. 

The reader is led to expect much from so imposing a list of con- 
iciUs, and his anttdpations arc fully realized in reading the book, for 
a clcar-ctil prescnuition is made of tlic scientific ^material collected. 
This is further supplemented by many illustrations of trade tests, 
rating scales, diagrams, piiolographs, etc. 

"Trade Tests" arc a Inr-product of the World War. Th^ ere the 
result of extensive scientihe research work conducted by the Committee 
on Classification of Pcr.soniicl under the direction of the War Depart- 
incnl to .solve tlic (irobicni of cfticicnt selection and placement of the 
army's skilled pcrsouriel. In view of the extraordinary success of the 
trade test instruments in the army, and having in mind the utter inade¬ 
quacy of the methods employed by industry at large, the author presents 
the findings as a metliod which, in a modified form, should be extremely 
useful to industry in solving its perplexing problcni of securing an 
adequate amount of the indispensable human element in the process of 
production. 

Piolc.ssor Clmpiiian bad a direct part in formulating the trade tests, 
and lie gives a clear and comprehensive statement in this volume of 
the conditions which gave rise to these tests, he discusses the methods 
of tlicir consiruclioii, their relative merits and demerits, and lie sug¬ 
gests their various possible applications to the problems of tlic indus¬ 
trial world with reference to its personnel. He sees an analogy be¬ 
tween the army and the problem of industrial employment, and be¬ 
lieves that by adapting these trade tests to the needs of employment 
bureaus and vestibule schools, industry will get much nearer the solu¬ 
tion of its problem. 

Under present slack conditions with great masses of workers idly 
twiddling their (luimbs, the idea of Introducing labor saving device 
appears, to say the least, somewhat ill-timed. One fears that the state¬ 
ment that "(le()lcled man-power is the sad aftennatli of war,” under 
present coiidilion.s, will be far from conducive to the wide circulation 
which the Imok nierit.s. Dr. Chapman evidently considers the present 
ebb in industry hut a fcmiiorary condition, and anticipates little difli- 
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culty from this direction. He fears that opposition may come from 
the man for whom the book is primarily designed,—from the employer 
who has liad sad experiences \yith unqualified individuals who have 
offered various inadequate solutions in the past, and that he may see 
in this extremely scientific method but another bogus cure. 

The work is written entirely from'the viewpoint of the employer's 
needs, emphasizing the benefits which the trade tests should yield to 
him; and one is disappointed that the author has not pointed out the 
advantages that should accrue to the workers and to society in general 
by the application of these tests. 

Veblen has pointed out the fact that the introduclioii of machinery 
has reduced everything to standardized units, not only production 
processes in industry, but man's working conditions, his living condi¬ 
tions, the goods he consumes, and his very needs, A disturbance any¬ 
where of this standardization means hartkhips. Since the human ele¬ 
ment is so important, which the author .recognizes, he offers these trade 
tests as a means of stabilizing this fluctuating human factor. 

Labor should be quick to sec the advantages it would gain by the 
extensive use of this method of gradation and selection, It should 
result in removing round pegs from square holes. Placing a man on 
the job for which he is fitted by nature, inclination and training, and 
where lie will have opportunity to express himself to the utmost, 
should strengthen what such students as .Parker, Veblen, Tead, and 
others, include in the general phrase of "instincts of workmanship,” 
The ideal consequences should be greater production for the enter- 
preneur, advancement and Increased pay and contentment for the 
workman, and a step toward industrial peace for society at large. 

The author is looking forward to the day when various scientific 
methods will be employed by private and public employment bureaus 
where by' means of an adequate examination the man seeking work 
will be given his trade rating and sent to the right job. He urges the 
imperative need of a more economical use of industry's great want, 
man power, 

"Trade Tests” is the result of much painstaking effort by such 
distinguished men as L. E, 'lliorndikc, W, D. Scott, the author, and 
others. All students of industrial problems will find in this scientific 
work a distinctly iieto method which, in connection with intelligence 
tests and skill prediction tests, gives promise of effectively applying 
psychology still further to the far-reaching problems of our national 
industrial life, The book cannot be too highly commended. It should 
receive the widest circulation. 

Clark University. c. x, schwenning. 

Knight Dunlap, "Myslictism, Freudianisni and Scientific Psychol- 
■ ogy." C. V, Mosby Co., St. Louis, Mo. 

This book may readily be classified as being of two parts: destruc¬ 
tive and constructive. Professor Dunlap has little use for Mysticism 
and Freudianisni, so the first two chapters on these subjects are de- 
stniclivQ in nature, while the third chapter or constructive part deals 
with the foundations of Scientific Psychology. 

Taking each term separately, the author devotes a chapter to each 
in a clean-cut description. Mysticism is defined as a belief in a third 
kind of knowledge which ranks higher in value than either of the 
other two. There are a number of conventional names, all of which 
are admitted to be metaphorical, for the act or fact of knowing in this 
assumed third way. Three terms especially have been employed to 
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designate this act; “union,” which emphasizes (he {undamciital char¬ 
acteristic that the subject who knows and object wliich is known be¬ 
come the santc by one being absorbed into the other; ''love/' that 
which attracts and binds together; and “ ccstacy/' wliicii allucies to 
the same alleged fact of the knowing subject losing its identity in the 
known object. After discussing the origins of the European Mystic¬ 
ism, Quasi-Mysticism and Pseudo-Mysticism, Professor Dunlap has 
this to say in the closing of die chapter: "In freeing itself from the 
arms and methods of science, Mysticism adopts without scruple a type 
of reasoning against which science constantly struggles, the type known 
10 the logicians as the fallacy of the ambiguous middle term or the 
‘ sliding term.’ ” 

The second chapter discusses Freudianism and tlic psyclioanalysisis, 
giving the origin, program and claims of psychoanalysis, and setting 
forth the essential postulate of the "subconscious mind.” The most 
important ideas or furniture of the mind arc “desires," the most im¬ 
portant being sex desire whicli is assumed by PTeudians to commence 
m the early weeks of infancy as autocrotisni. This hypothesis of 
infantile sex life is founded on the specific fallacy of “ secundum quid." 
The final consequence of this method is to define sex as the whole uni¬ 
verse, whicli would necessitate the derivation of a new term for what 
is ordinarily considered sexual. Freudianism, like Mysticism, is also 
unscientific divulging into the fallacy of the ambiguous middle term 
and venturing into n realm resembling that of the third kind of knowl¬ 
edge of Mysticism. 

Anything to be scientihe must be, like Scientiiic Psychology, founded 
upon certain sciciitilic procedure. Science must start from an empirial 
basis of the facts of experience; must form, according to the law of 
parsimony, a working hypothesis, subject to experimental investigation, 
into which the observed facts must fit; and must pay extreme care to 
significance of terms. Such principles readily exclude at once the 
dangers oi Mysticism and pave the way for a genuine pliysiological 
psychology or psychobiology, which is portrayed in the third chapter. 

While being opposed to the Freudian movement, the author asserts 
the opinion, however, that its final result may be beneficial, Just as 
Christian Science has tremendously accelerated the progress of scien¬ 
tific medicine, so psychoanalysis, by compelling psychology to put its 
own house in order, will eventually help in the development of Scien¬ 
tific P.sychology. But in the fear that in the meantime many may be 
deluded into the "short-cut” methods of Mysticism and Freudianism 
rather than adhering to the slower but more solid procedure of sci¬ 
ence, this book was written. 

Clark University. Clinton s, Leonard. 

W. Whately Smith, "The FoKudalion of Stiiritualism." E, P. 

Dutton & Company, New York, 1920, p. 123. 

This book is a discussion of the fundamental bases of spiritualism. 
The author examines the various phenomena which serve as a founda¬ 
tion upon which the claims of spiritualists arc built. 

A large part of the book is taken up in analyzing the spiritualistic 
phenomena which arc used as evidence for survival and gives some 
instances of automaUc writing which seem to show that departed 
spirits take some interest in, and maintain some measure of contact 
with, the world they have left. He also takes up the arguments against 
the spiritistic hypothesis and says that "the true case against the 
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spiritistic liypotUesis is simply tUat our knowledge of abnormal psy- 
cliology is not, at present, extensive enough to admit of oitr assigning 
definite limits to what can be achieved by the incarnate mind under 
suitable conditions, and that, until we are in a position to do so with 
reasonable precision, we cannot possibly say that any pariictilar feat i» 
beyond its powers and therefore necessarily due to the interventions 
of discarnate intelligences.’' Part II of the book has to do with "The 
Process of Communication” and the author concludes that the whole 
subject is so obscure "that it is at present premature to express any 
opinion whatever as to the nature of the next life.” He docs, how¬ 
ever, suggest a few conclusions as to the nature of the individual in 
the next life. The author is somewhat shaky in his conclusions and 
admits that a great deal of die evidence is unreliable and perhaps only 
about 5% is dependable. It is hard therefore to sift the reliable evi¬ 
dence from the unreliable. He states that wholesale denial of the 
facts of spiritualism merely displays ignorance of the subject and 
concludes that “the subject is one which should be dealt vvith exclu¬ 
sively by the expert and not the amateur,” and that spiritualism is to 
be deprecated " because pf the scientific immaturity of the whole sub¬ 
ject, the great difficulties connected with it, the unfortiinatc tendency 
of Spiritualists to indulge in unwarrantable, and sometimes heterodox 
extrapolations from the facts, and the ever-present danger that their 
iininstructed adherents accept as inspired revelation matter which is 
really no more than the product of incarnate subliminal activities." 

The author’s style is clear, the method analytic. He assumes a criti¬ 
cal attitude throughoot and weighs carefully the evidence in favor of 
and against survival. The book is a sane analysis of spiritistic phe¬ 
nomena and should prove helpful as a careful and critical review to all 
interested in Spiritaalism. M. meenes, 

Courtis ^'toiitfArd Practice Tests in Haudviriting. ’IJy .STUAW A, Cour¬ 
tis and Lena, A. Shaw. Specimen Set, 50 ceiitb postpaid. Yonk- 
erS'On-Hudsoii, New York; World Book Company. 

This material, like the Courtis Standard Practice Tests in Arith¬ 
metic, is thoroughly standardized. Three ^ars' trial in schools, before 
it was placed on the marlcet, left no doubt on its success in use. 

Convinced that writing is a trick which the pupil must learn for 
himself, though his teacher may help him at times, the authors have 
placed before the child definite attainable goals, based on standards, 
and have provided exercises that enable him to reach those goals. 
Through these exercises, the individual needs of the children are 
met and the routine of classroom work is avoided. Children learn 
quickly how to use the material, and enjoy using it. 

Standard research and supervisory tests are included in the material; 
by their use it is easy to discover just what kind of drill work children 
need, and how much. 

The results from using the tests are very remarkable, many in¬ 
stances showing that even with less practice time than usual, children 
doubled their speed and quality of writing when they bad used the 
Courtis Standard Practice Tests in Handwriting. 

Bulletin No, 1 gives complete information on the material. 

Ordway Tead and Henry C. Metcalf. Personnel Adininistfaiion. 

McGra.\v-HiU Book Company, New York, 1920. pp. 538. 

In "Personnel Administration” the authors are offering the public 
a most timely book. While they may appear to be somewhat premature 
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in setting forth in a systematized manner llic " principles" and 
“standard practices" of a field so new and imforrned as that of the 
administration of human relations in industry, it is in just this respect 
that the authors arc performing an extremely useful service. They 
have taken the bewildering mass of written material rcl-’live to this 
extensive topic and have subjected it to a critical fixamiiiation, careful 
selection and classification before {jutting it in book form, and so 
have answered a definite need. It is in this .work of ex(»crl organ¬ 
ization and sifting of the sources rather than iii the originality of 
the data presented in which the writers of this volume have made 
their greatest contribution. An additional feaiiiro which makes ihe 
book valuable is the voluminous and excellcnlly classified bihliography 
given at the dose of each chapter. 

The volume will be useful as a haiidboolc as well as a text for class 
purposes, and will have value to all "who arc interested to advance 
right human relations in industry," be they social welfare workers, 
students of industrial problems, the workmen them.selves, consumers 
or the managers. A clear, concise djscussion is given of the variovis 
elements that constitute the science of personnel administration. The 
more important of the numerous metliods that are being successfully 
employed by progressive industries are related, and significant gen¬ 
eralizations are drawn from this material. The hook does not pro¬ 
pose to offer a panacea for all industrial ills. It does claim, and the 
claim seems to be Justified, to contain a method that is working in 
the right direction, and bases its claim on the sttccess which has 
attended the application of these principles wherever they have been 
properly applied, 

In the estimation of the reviewer, the authors wisely urge the point 
that the problem of directing human beings is a permanent one, i,c., 
that it will remain wherever and so long as there exists the “ rela¬ 
tionship of employer and employed, of manager and managed,” and 
this entirely independent "of the problem of owncrsliip in industry." 
So long as this dual relationship in industry exists—and this seems 
to be ad iiifiuitim —the problems involved in engaging men and in 
directing their activities while at work will remain no matter how 
often the ownership of industry changes. If the problem Is inherent 
in industrial society, ii is clear that a complete solution cannot well 
be devised over night, and that a wider and.more systematic study 
of the underlying principles that will make for as little friction as 
possible ill our industrial organization is of great importance. 

Chapter II on “Human Values in Industry” reiterates, ably though 
only briefly, yet again the need of reckoning with the iiidi-spensablc 
human factor without which no concern can long exist. The chapter 
is based on the fundamental human instincts and urges anew that they 
are found universally in the managed as well as in the managing, a 
consideration that has too long been neglected with unfortunate 
results as a consequence. To be sure, "it is manifestly true that in 
a majority of corporations production is to-day affected adversely not 
so much because of technical inadequacies as because of the failure 
of inanagcr.s to recognize that workers are human beings who demand 
the considerate treatment which only intelligence and iiisiglil icgarding 
human nature can suggest." 

In reading this book one is impressed witli the bigness of tlie task 
of personality direction and with the tremendously large, delicate 
and intricate machinery it necessitates creating to successfully man- 
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age this human section <j{ modern industry. The nature of the piob- 
lems involved, their implication'to the welfare of society at large, 
and their bearing upon the productiveness of industry, these elements 
elevate the profession of personnel administration to a high plane and 
first rank in industry. This point is stressed by the authors calling 
attention to the fact that upon sympathetic interest, mature judgment 
and adequate preparation in the social sciences depends the successful 
direction of so delicate and responsible a task as that involved in 
this calling. 

A.11 those interested in producing and maintaining cordial human 
relations in the industrial world will welcome this excellent text on 
personnel administration. 

Clark University c. T, sCHwenning. 

David E. Berg, Pcrsoualily evihtre by College Focvllics. Institute for 
Public Service, N, Y. CUy, cloth, 128 pp. $1.50, 

This is a study of 72 university instructors in 100 classes in 25 
subjects, A Summer was devoted to visiting the classes. A descrip¬ 
tion of each teacher as seen from the viewpoint of the students is 
given. Early observations of eight instructors revealed the examples 
of personalities ranging from the “zaiith to the nadir” in teaching 
ability,—“ the poor teaching power being due to correctable faults of 
personality.” With each group of personality portraits from the 
“lower levels” in personality to the “personalities plus,” is given the 
outstanding personality elements that determine the classification 
Each picture is so fully described as to show clearly those qualities 
of personality that should be cultivated and those avoided.. 

Of a total of twenty-two there were eight of high class personality, 
six medium and eight of defective personality, 

Some of the desirable volitional elements listed are "exacting, 
moral courage, aggressiveness, decisiveness, dynamic" and among the 
opposite are "laxity, subservience, timidity, irresolution, discouraging,” 
The 72 instructors as the result of analysis and classification fall into 
10 grades of teaching ability. It is the hope of the author that this 
attempt to distinguish these various grades of teaching ability may 
stimulate teachers toward self-analysis of their own ability and en¬ 
courage colleges to consider more comprehensively the subject of 
teaching personality. 

Every college is urged to organize a committee to study teaching 
personality and efficiency and give the committee power to study, 
analyze and formulate recommendations for improvement, that this 
committee formulate minimum standards of teaching personality, and 
study their own pedagogical problems. 

This book has a fact basis for its contend and its concreteness will 
enable it to be of valuable service to present teachers and teachers-to-be. 



NOTE 

Funds fok Scientific Reseahch 

Tlie Rescaich Infoimatioii Service of the National Research Council 
has recently compiled information about funds for scientific research. 
From this compilation it appears that there are hundreds of special 
funds, trusts, or foundations for the encouragement or support of 
research, in the mathematical, physical and biological sciences, and 
their applications in engineering, medicine, agriculture and other use¬ 
ful arts. The income from these funds, which amounts annually to 
at least fifty million dollars, is used principally for prizes, medals, 
research scholarships and fellowships, grants and sustaining appro¬ 
priations or endowments, 

So numerous have been the requests to the Research Council for 
information about sources of research funds, availability of support 
for specific projects and mode of administration of particular trusts 
or foundations, that the Research Information Service has created a 
special file which it is proposed to keep up to date in order to answer 
the questions of those interested in such funds. Furthermore, in order 
to give wider publicity to the immediately available information about 
research funds, the Council has issued a bulletin under the title "fluids 
cvailabic in igso in the United States of Awerica for the oncowiiffc- 
mciit of scientific research^ 

Inquiries concerning the bulletin or for information about research 
funds should be addressed. National Research Council, Information 
Service, 1701 Massacliiisetls Avenue, Washington, D, C, 


The following hooks and pamphlets have been received :* 

Army Lessons in English (7 copies). School Office, Recruit Educa¬ 
tional Center, Camp Upton, N. Y. 

Bureau of Business Research, New York University, Attention Value 
of Advertisements. Tlie Graduate School of Buslncs.s Adminis¬ 
tration of New York University, November, 1920. pp. 32. 

Commissioner of Education- A Survey of Education in Hawaii. 
Washington Government Printing Office, 1920. pp. 

Education for Citizenship. Washington Government Printing Office, 
1921. pp. 30. 

Education for Highway Engineering and Highway Transport. Dept, 
of the Interior. Washington Government Priming Office, 1921. 
pp. 134. 

Mabel R, Fcrnald, Mary H. S. Hayes and Almena Dawley. A Study 
of Women Delinquents in N. Y. State. The Centiiry Co., 353 
Fourth Avc., New York City, 1920- pp- 542, 

E, H, Fish, How to Manage Men. The Engineering Magazine Co., 
New York, 1920. pp. 33/. 

* Mention here docs not preclude further coiiimeiit 
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Edward A, Fitzpatrick, Genesis anti Purpose oJ Vocational School 
Survey, Beginnings of Continuation Schools in Wisconsin, History 
of Continuation Schools in Wisconsin. State Board of Education, 
Madison, Wisconsin, 1921. pp. 23. 

Capt, J. M, Hanson (Editor). The Inter-Allied Games. Games Com¬ 
mittee, 1919, pp, 511. 

Prof, G. B. Hotchkiss, R, B. Franken. Newspaper Reading Habits of 
College Students. Association of National Advertisers, Inc,, New 
York City, pp, l5. 

Hoyt and Pect. Everyday Arithmetic, Primary. Houghton Mifflin 
Co., Boston, New York, Chicago, 1920. pp. 276, 

Hoyt and Peet, Everyday Arithmetic, Intermediate, Houghton Mif¬ 
flin Co,, Boston, New York, Chicago, 19^. pp. 276. 

Hoyt and Pcet, Everyday Arithmetic, Advanced, Houghton Mifflin 
Co., Boston, New York, Chicago, 1920, pp. 324. 

Principles, Plans and Purposes of the Educational Program of the 
Recruit Educational Center, Camp Upton, N. Y., 1920, pp. 19. 

Luella Cole Pressey. The Relation of luteUigencc to Achievement in 
the Second Grade, From Bulletin of Extension Division, Indiana 
University, Vol, VI, No. 1. pp. 80. 

National Intelligence Tests. World Book Co., New York, 1920. pp. 32. 

Carl E. Seashore. A Survey of Musical Talent in the Public Schools. 
University of Iowa, Iowa City, 1920, pp, 36. 
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THE MEASUREMENT OF AGGRESSIVENESS 


By H. T, Mooki: aiul A. R, Gii.lii.ani), Dartmouth College 


The term aggressiveness, as here used, is synonymous with 
personal force, initiative, assurance. It is thus understood 
as standing for that iniit whicli in combination with intelli¬ 
gence and reliability goes far towards completing the essen¬ 
tial personal recjiii.siles for success. Translated into the term¬ 
inology of McDougall it is equivalent to an abundance of self- 
assertion and piignticity, and a ininiinuin of fear. Described 
behavioristically it is invariably contrasted with the attitude 
of inferiority or submission, 

While we may never lind exactly the same pattern of ag¬ 
gressive behavior in any two individuals, there is nevertheless 
a widespread and reasonably estalilislied belief that one gen¬ 
erally knows what tu expect of the aggressive man in ntost 
of the ordinary circunislancc.s of life. He is more likely to 
be vigorous, positive, and masterful than the man lacking in 
this trait; and lie is le.ss likely to shrink from notice, to avoid 
{iiguiiient, to (lisiilay a lack of “ nerve," Generally speaking 
his chances of success in any type of undertaking are higher 
rhan those of the average man. Undue aggressiveness may 
handicap personal |)r()gre-ss in a certain number of ca.scs, but 
it is probably not so much the excess of personal force as tlie 
lack of tact and sympathy that is the drawback in such cases. 
So wc may say with only slight qualilieatioit that, other things 
being equal, the measure of a man’s aggressiveness is the 
measure of his chance of success. 

The laboratory tests of aggressiveness here reported are to 
some extent the outgrowlli of ihe instinct-emotion tests re¬ 
ported previously in the //unv/niii Jounuil of Psychology.' 

1 "A Melliod of ’I'l'.sliiic' tin- .Strt'iic'tli uf Iiislitiei.s." J. J. }'. A|ii'il 
1916, 227-X]\ and "l.iilmraiory ’I'csis of I'oai', Anyoi' and Sex 
Interest." .-J. J. /'. July 1917, .190-5. 
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But the method of attacking the problem is fiindameiitally 
different. The first step in the present experiment was to 
find two groups of subjects who contrasted to a niailced degree 
in the trait in question. This condition was met l)y taking 
from a class of 89 students the highest and lowest fifteen 
per cent as rated on aggressiveness. This gave thirteen men 
in each group. Reliable ratings of these men were obtained 
only after much labor, but it is believed that the method used 
is quite satisfactoiy for the present purpose, namely that of 
guaranteeing a marked difference in aggressivene.ss l^etween 
the highest and lowest groups. 

The rating of each man was determined by averaging two 
types of estimates, those made by the faculty and those made 
by fellow students. In order to secure standard faculty ratings 
the department of psychology proposed to the faculty a gen¬ 
eral “iystem of personal ratings of the students, Tlie plan 
which was adopted is similar in many respects to the officers’ 
ratings used in the army. At the end of the college year each 
instnictor files in the office of the Registrar a rating sheet 
containing his personal estimates of the men under his in¬ 
struction, The estimates are made on a scale of five letter 
grades, as in the case of scholarship marks, and the traits 
judged are intelligence, aggressiveness, reliability and person¬ 
ality, all of them carefully defined on the rating slieets pro¬ 
vided for each instructor. To offset the possibility of per¬ 
functory and therefore careless ratings the point is stressed 
that no vnsivuctof shall under any circumstances submit any 
ratings which fail to represent a reasonable amount of confi¬ 
dence on his part. It is urged that where it is impossible for 
a real judgment to be formed, a blank is to be preferred to 
a forced opinion. Conformably to the above plan the Dart¬ 
mouth faculty submitted in June 1920 personal data concern¬ 
ing 1,480 students. Practically all the men in the class of 85' 
students from whom the subjects for the experiment were 
to be taken were rated by from three to five of their instructors. 

Student ratings were similarly obtained from the members 
of the class. Each student was asked to rate those of his 
fellow students whom he knew particularly well. From the 
averages of the faculty and student ratings the list of the 
thirteen most aggressive and the thirteen least aggi'essive men 
was now determined. After making ail possible allowance 
for individual inaccuracies of rating, it seemed absolutely cer¬ 
tain that the thirteen highest men, taken as a group, were 
conspicuously more aggressive for any purpose whatsoever 
than the lowest thirteen men. As corroborative of this It is 
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\i’orlli iiientinniiif^ that the thirteen liigliest men jncliidecl the 
president of the senior class, the business manager of the 
college daily, the inanagcr of track athletics, the quartcihack 
of the footinill team, the president elect of tlie Outing Club, 
and an officer of tlio Dramatic As.sociation prominent in the 
production of stv\dent plays. The lowest thirteen men were 
decidedly without prominence in college activities, 

To be sure, a certain amount of the difference between the 
two groups is to lie attribiUed to the factor of intclligeuce, and 
indeed this faeu>r can never he completely isolated in any 
study of personal clilTerfuces. But an examination of the 
intelligence rating.s and the .scholarship marks of the two 
groups here studied shows that they differ l^y far less in 
vcspcct to intelligence than in respect to aggressiveness. If 
the selection had been of the highest thirteen men in the class 
on the basis of intelligence ratings, only four of our most 
aggressive men woishl have ijualilied, and one of them would 
have been included in a list of the thirteen least intelligent. As 
against lhi.s we have the f:ict that five of the least aggressive 
were also rated among the thirteen least intelligent, and none 
of them among the thirteen most intelligent. The average of 
the scholarship marks of the thirteen most aggressive men is 
2.5 on a scale of 4.0 as (he inaximuin, This i.s about of a 
])oint higher than (he general average al the college, The 
average of the thirteen least aggressive men is 1.7, about .5 
of a point lower lliaii the college average. There is then 
real difference in intelligence in favor of (he most aggressive 
group, almo.st nece.ssarily .'^ 0 . hut it is not to l)e compared with 
the difference in aggressiveness. Not one of the highest group 
had an average rating of less than B 011 aggressiveness, and not 
one of the lowest gnuij) Inul an average rating of more than 
D on the same trail. 

Having tlins ftniiid two groups who difi'ered in nothing so 
innch as in aggressiveness, ilie next step was to (ry our tests 
which .seemed calculated (o give marked and consistent clif- 
fercnces of results for the most and the least aggressive groups, 
The assumption was that such le.sis tvoiild have consideralde 
>ignificance as ad'ordiiig a measure of the (rail. It was hardly 
to ]jc hoped that any single te.st would show a imliii for [)oint 
correspondence with the exislence of the trait,—though the eye 
niovement test doo.s almost approximate such a correspondence, 
but the expeelatioii was that a gniuping of seveial .significant 
tests wouhi offer a highlv suggestive ]iicl\ire o\ die trail in a 
given individual.—an aggressiveness profile,—lo usi‘ nrnviicv's 
expression. 
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TABLE I 

Eye Movement Test 


1 

Name j 

No. of Eye Movements 


C.N. 




Z.J. 

0 1 



A.C. 

2 



R.M, 

1 1 



N.A. 




J.G. 

1 1 ' 



E.B. 



Most Aggressive. 

B.W. 




R.W. 

1 1 1 



H.C. 




A.J. 

0 



E.L. 

1 



D.R, 





1 ' 

Total 6 


H.M. 

7 



J.J. ' 

1 



E.R. 

4 



W.P. 

4 



N.F. 

4 



P.G. 

5 


Xeast Aggressive. 

F^. 

7 



J.N. 

0 



G.D. 

5 



R.B. 

16 



S.H. 

0 



R.T. 

5 



B.R. 

14 





Total 72 


I 

Eye Contboi, in Personal Interview 

Cominon sense has it that the shifty eye is generally a sure 
of personal weakness, if not of downright dishonesty, 
ilie first test was designed with a view to bringing this ele¬ 
ment of behavior into quantitative relation with the trait ag¬ 
gressiveness. Each of the twenty-six subjects was required 
to perform a somewhat difficult series of mental additions 
while constantly returning the fixed gaze of the instructor who 
addition series were standardized as to 
dimciilty as described in test II, and the subject performed 
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[hem with the knowledRC that accuracy and speed were essen¬ 
tial. Bvit he was einpluitically instructed that under no cir¬ 
cumstances should he let liis Raxc wander from that of the 
man facing him, as all innvements of the eyes were to affect 
his score seriously. 

The details of the addition series are described in the fol¬ 
lowing test, 'i'he record for each subject is the total number 
of eye inoveinenls recorded against him during five series of 
additions. Table I gives the records of the twcuLy-six subjects. 

It will be seen tliat a total of 72 movement.^ are recorded 
against the least aggressive as compared with 6 against the 
most aggressive men. Not one of the aggressive groui) averted 
his gaze more than twice during the five scries of additions, 
whereas ten of the thirteen least aggressive subjects shifted 
their eyes four limes or more. If a steady eye does not posi¬ 
tively guarantee the presence of aggressiveness, as may be 
judged by the fact that three of the least aggressive subjects 
were able to niaiiuafn pnictically constant fixation, a marked 
lack in tliis respect Is almost invariably accompanied by a 
lack of aggressiveness. 

The question luiturally arises whether eye control in per¬ 
sonal interview is not perhaps more a mailer of " reliability ” 
than of aggressivcnes.s. To lest this point 'liie thirteen most 
reliable anti the lliirleeii least reliable men in the class, as 
determined by faculty ratings, were suhmilleil Lo the same ex¬ 
periment. Eight of the thirteen least reliable " were able 
to keep within a linnt of two eye movements, and the total 
of the thirteen subjects was 41 movemcius as compared with 
72 for the thirteen least aggressive. Six men were common to 
the two groups, which would indicate a fairly high correlation 
between the two traits, hut the record fov eye movements 
evidently poini.s to a much more* definile relation lielwcen 
eye control and aggres.siveness lhaii i.s the case with I’elinbility. 

Whether we compare the average inunher of movements 
of the aggressive and the unaggressivc .subjecli?, or compare 
the number of subjects in ihe two groups who lost control to 
the extent of malcing two or more eye movenienLs, we find 
evidence of at least ten limes as much control in tlie upper 
group as in the lower. Thus the simple behavioristic fact of 
the ability to look another person in the eye seem.s to have 
.such a high signilicance regarding the presence or jib.sence of 
aggressiveness as to warrant giving it an extremely jiroiTiinent 
place in any scoring luelhod devisetl tis a measure of this trait. 
The corre.spondencc is in fact .so close as lo ju.slify ihe gen¬ 
eralization that a slop watch and a |)air of fixed eyes arc the 
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only iiiclis[)cnsable laljoratory cqiiiiJiiiciU m-cfssary fen- ostimai- 
ing roughly ihe degruo of jiggrcssivciicss in ill luast four-fiftlb; 
of Lhe subjects. 

11 

1'kar Disi'HAiTinx ’I'usi's 

The puipose of the clisirnclion U'sts was in elcu-i-minc liov 
fai the aljility to rcsisl a tyjw of <lislracliou involving; a cvriaiii 
element of feav is R-UUed lo lliu possession or lack of ag¬ 
gressiveness, Preliminary lo all of these tcsl.s each subject 
was required lo practice lifly limes pcrftirniing menial addi¬ 
tions according to a uniform plan involving coiistanl incre¬ 
ments of one, through a series uf nine additions. It such a 
series licgan with 36, it would coiuiiiuc; 37, 39, 42, 46, 51, 57. 
64, 72, 81. If it began at 29, it would continue; 30, 32, 35. 39. 
44. 50, 57, 65, 74. Thus a scries might begin with any minilier 
aud would consist of nine addilkms, the numbers added l)ciiig: 

1,2, 3.4, 5, 6, 7, 8, and 9. On ihc day prior lo ilu; (‘xpeiinieiii 
each suliject had practiced .such additions with series. 

Thi.s aJiiouiit of practice sccinccl to bring each iiirm reasonably 
near to tlie limit of his natural ability at such a Utslc. Tin- 
thirteen most aggressive siibjecls were able rifler tlii.s riinount 
of practice to perform ten serie.s of additions undoj- normal 
conditions at an average time of 12.6 secojuls- 4’hi: lliirlocn 
least aggressive .subjects averaged 15.6 .seconds for the same 
ten serie.s under normal condition.s. The iiiediaii of ibe 
thirteen mean variations for the normal series of lhe aggressive 
subjects was 2.0 second.s; that for the least aggressive sulijecis 
was 2,.3 seconds. The difference in the normal variabilily 
Of the two gvoujMS was thus negligibly small. In the com¬ 
parison of any two individuals the factor of norma! varialnliiy 
in the addition series will have lo he taken inla account, but 
for purposes of comparing these two groups as a whole it is 
of les.s importance. 

Distraction by Staring 

Immediately after die ten normal serie.s were completed tlic 
subjects were asked to perform the same tii.sk under condition.' 
of slight emotional distraction. The fir.st of ihc.sc di.stractions 
was that of having to meet the fixed gaze of the instriicttjr 
facing the subject, as described in the eye movement le.si. 
This distraction record is in fact the time record which was 
obtained simultaneously with the eye movement score. While 
one experiiueatei- counted the eye movements which gave the 
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record for Table I, another timed the five series of additions 
performed under these conditions. The average increase of 
time as conijiared with the normal average is obtained as the 
measure of the subject's distraction, Table II gives the results 
for this test, 

TABLE II 

Distraction Test—Staring 




Time 

A.D. 

No. of Cases 

in wliich 


Name 

Increase 

Without 

Distraction Time is 



With Test 

Distraction 

Greater Than A.D. 


C.N. 

—1.9 

.6 




Z.J. 

.4 

2.3 




A.C 

.4 

2.8 




R.M. 

— .1 

2.0 




N.A. 


1.3 

i 


Most 

J.G, 

— .4 

2.5 



Aggressive 

E.B. 

5.1 

1.2 

i 


D W. 

— .1 

3.5 




R.W. 

0. 

.8 




H.C, 

5 

2 8 




AJ, 

.0 

2 5 




E.L. 

2.<> 

1,0 

i 



DR. 

-1.4 

13 








Total 3 


H,M. 

9.7 

2.5 

1 



J.J. 

1.4 

3.5 




E.R. 

r>:2 

2.7 

i 



W.P. 

2.5 

2.1 

1 



N.F. 

— .5 

2.3 



Least 

P.G. 

— .6 

1.8 

... 


Aggressive 

F.B. 

•1.9 

2.4 

i 


J.N. 

—2.0 

2.6 

... 



C.D. 

— .3 

1.5 




R.B. 

: 2.8 

1.4 

1 



S.H. 

4.8 

1.5 

1 



R.T. 

5,0 

4.2 

1 



B.R. 

8 9 

2.0 

1 

Total 8 


The most aggressive subjects are listed in ihe upjier half of 
the table, ami the least aggressive subjects in the lower half, 
The first ccilunm mimhcrs shows the average ainouai of time 
iiicrca.sc of each subject luicler llic dislractioii conditions, as 
iiieastiicd by com():iring the average time for the live .staring 
Icst.s willi the average lime for the ten normal trials. When 
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the time made in spite of distraction was more rapid than 
normal, this is indicated by a minus sign before the number. 
The middle column gives the average deviations for each 
subject in the normal series, and the right hand column indi¬ 
cates the cases in which the amount of time increase under 
distracting conditions was greater than the average deviation 
under normal conditions. The results may be summarized 
as follows: for the aggressive subjects the staring caused an 
average delay of .4 of a second; for the iinaggressive sub¬ 
jects it caused an average delay of 3.2 seconds. Only three 
of the aggressive subjects were delayed by an amount equal 
to their average deviations under normal conditions, whereas 
eight of the unaggressive subjects have a distraction time 
greater than, the A. D. The results indicate therefore approxi¬ 
mately three times as much ))robability that an unaggressive 
person when stared at will be deterred to a coii.siderablc degree 
than that an aggressive person will he thus delayed. 

Distraction by Electric Shock 

In the second of the three distraction tests the element of 
distraction was the exi)ectation of an electric .shock which 
was to come during or at the end of each of the fwe series of 
additions. The subject was told that lie would receive shocks, 
which might be of any intensity from 75 to 220 volts, and 
which might be expected at any time during or between the 
addition series. Actually he was not given more than 75 volts 
at any time, and the shock was always given just as he was 
finishing liis last number in a series, so that the distraction 
was almost wholly imaginary rather than sensory. 

The accompanying picture shows the apparalus used in the 
shock test. 

The base of the apparatus consists of a 9 by 18 inch board, 
divided into two square sections by a board upright 5 inches 
high, An electric light plug and five sockets, fitted with 60 
watt lamps, are on one side of the partition, Tlie sockets are 
interconnected by a combination of series and parallel wiring. 
On the other side of the partition are a small voltmeler and 
two binding pasts, The voltmeter and the posts are connected 
to the lamp sockets by four wires running through the parti¬ 
tion. Two brass hand electrodes are connected one to each 
binding post. By tightening or loosening certain lamp bulbs 
a difference of potential of 75 or 220 volts can be sent either 
through the meter, or to the electrodes, or to both. The lamps, 
of course, are lighted whenever they are thrown in the circuit, 
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Diagram Showing Wiring for the Electric Shock Apparatus. 
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Electric Shock Apparatus 

but they are partially shielded by the partition, and carbon 
lamps are used so as not to produce a bright distracting light. 

The subject is seated by a table on which the apparatus 
rests, The experimenter hands the subject the electrodes and 
says: “ This is an electric apparatus. As you begin your 
additions I shall begin manipulating these light bulbs. When 
I loosen or tighten certain bulbs yon will receive an electric 
shock, It may be weak or strong. It is not dangerous, but 
may be very uncomfortable. Just to show how it feels I will 
give you a weak shock. Watch the pointer on the voltmeter.” 
The subject is then given a shock of 75 volts. The electrodes 
ai'e laid on the table, and the subject is asked to watch the 
voltmeter while another manipulation sends 220 volts through 
it. He is again told to take the electrodes in hand, and the 
test begins. The experimenter continually manipulates the 
bulbs during the adding, and just at the last addition in each 
series the subject receives a shock of 75 volts. No shock 
is given during the adding, but the subject is continually in 
a state of expectancy. Each subject is bound by a promise of 
secrecy regarding everything about the experiment. The tests 
were completed in two days and no subject had any kirowledgc 
further than that there was to be some kind of electric shock, 

The results are given in Table III, and according to the 
tabular scheme already described for Table II. 

The figures for time increases in the left hand column show 
tliat five of the aggressive subjects resisted the distraction 
with complete success, whereas all of the twelve, unaggressive 
subjects were positively affected to the extent of an increase 
of 2.5 seconds or more. The average shock-delay of the 
least aggressive subjects was 6.1 seconds as compared with 
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TABLE III 

DiSTitACTioN Test—Shock 




Time 

A.D. 

, No, of Ciises 

in which 


Name 

Inci*ease 

WilJioiil 

Distraction Time is 

1 


With Test 

Distraction 

! Greater Than A.D, 

i 


C.N. 

2.9 

.() 

1 

1 



Z.J. ' 

2.5 

2.3 

; i 



A.C, 

10.0 

2.8 

1 1 



R.M. 

; 3.0 

2.0 

1 1 



N.A, 

, .1.8 

1.3 

1 1 


Most 

J.G, 

5.8 

2.5 

! 1 


Aggressive 

E.B, 

3.0 

1.2 

1 


B,W, 

—2 3 

3-5 

1 



KAV. 


.8 




H.C. 

: 0- 

2.8 




A.J. 

— -f) 

2.5 




IL.L. 

8.0 

1.0 

1 

1 


D.R. 

— •] 

1.3 





! 



Total 8 


I-l.M; 

' 10.1 

2.5 

1 

i 1 



JJ. 

9-9 

3.5 

1 



E.R. 

i (>.0 

2.7 

i 1 



\V,P, 

i 17.1 

2.1 

i 1 



N.F, 

1 3.3 

2.3 

! 1 


Least 

P.G. 


1.8 

i • • • ' 


Aggressive 

FB. 

1 2.5 

2.4 

1 


J.N, 

2.6 

2.6 

1 



G.D, 

i 4.7 

' 1.8 




R.B. 

; 5.5 

1.4 

! 1 



S.H. 

! 3,8 

1.5 

1 



R.T. 

1 2.9 

4.2 




B.R. 

1 4.7 

20 

i 

Total 11 

1 (One score 
* nhssiriR) 


an average ol 2.2 seconds for ihe aggressive group. The indi¬ 
vidual variations among the aggressive subjects seem to indi¬ 
cate that this test ha.s a less specific relation to aggressiveness 
than does the staring test, and this is somewhat borne out 
by the fad that when the same tc.st was given to the thirteen 
most reliable and the thirteen least reliable men in the class, 
the difference was by far more striking than for the aggie.ssive- 
ncss groiip.s, Only one of the tliiiTcen " most iclinbic " men 
liad a shocU-delay of more ihan Ihrce .second.^, whei-eas eleven 
of the thirteen “least reliable” men had delays upwards of 
three seconds. However, the fact that lire ability to with- 







108 


MOORE AND GILLILAND 


Stand shock distraction is possessed by 40 per cent of the 
aggressive subjects and by none of the iinaggressive ones 
justifies the incUision of this test as having considerable 
symptomatic value regarding the trait. 

Distraction bv Snake 

In the third test the method of distraction was to place a 
dead snake, suitably coiled, and pinned to a cork board, about 
■ten inches in front of the face of the subject during one-half 
of his adding. Only one series of additions was recorded for 
this test, as it was found that adaptation was very rapid, This 
means, of course, that the results liave a larger probable error 
than those recorded for the other types of distraction, The 
detailed record is given in Table IV. 


TABLE IV 

Distraction Test—Snake 




Time 

A.D. 

No. of Cases in which 


Name 

Increase 

Without 

Distraction Time Is 



With Test 

Distraction 

Greater Than A.D. 


C.N. 

9.1 

.6 

1 1 



'U. 

4.4 

1 2.3 

1 1 



A.C, 

6.6 

2.8 

1 1 



R.M, 

1 2.7 

2.0 

1 



N.A. 

' 3.6 

1.3 

1 


Moat 

, J.o. 

10.6 

2.5 

1 


Aggressive 

E.B, 

7.7 

1.2 

1 


, B.W. 

4.3 

3.5 

1 



1 R.W. 

1.4 

.8 

1 



, ac. 

— .5 

2.8 




A.J, , 

4.3 

2.5 

i 



E.L, 1 

5.9 

1,0 

1 



D.R. 1 

0. 

1.3 


Total 11 


H.M. 1 

9.7 1 

2.5 

1 1 



JJ. 

11.4 

3.3 

1 



E.R. 

12.6 

2.7 

1 



W.P. 

.1 

2.1 




N.P. 

1.1 

2,3 



Least 

P.G, 

9.8 

1.8 

i 


Aggressive 

F.B. 

21.7 

2.4 

1 



J.N, 

.8 

2.6 




G.D. 

8.7 

1.8 

i 



R.B, 

11.6 

1.4 

1 



S.H. 

3.2 

1.5 

1 



R.T. 

7.0 

4.2 

1 



B.R. 

9.5 

2.0 

1 

Total 10 
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The time increase for practically all of the subjects was 
greater than the average deviation in the normal series, but 
the average delay of 8.2 seconds for the imaggressive subjects 
was practically double the 4.6 seconds for the aggressive ones. 
Tlie most noticeable fact here was the greater liability of the 
imaggressive subjects to become somewhat panicky. Geit- 
erally a delay of nine seconds or more was accompanied by 
very definite nioveuieiits of withdrawal or avoidance, and it 
will be seen from the figures in the first column of the table 
that eight of the imaggressive men were delayed by nine sec¬ 
onds or more, as compared with only two of the aggressive 
men who were so delayed. The imaggressive man’s liability 
to panic in the presence of a snake seems to be about four 
times as great as that of the aggressive man. It is interesting 
to note further thit this test showed no relation to reliability, 

III 

Word Association Tests 

The word association tests were designed with a view to 
finding out whether the study of res|ionses to selected stimulus 
words would give reliable data for the differentiation of men 
as aggressive or unaggressivc. The six words selected as 
stimuli for this te.st were: ‘enterprise,’ ‘success,’ ‘ danger,* 

‘ deatli/ ' opponent,' and ‘ company.' ‘ Enterprise ’ and ' suc¬ 
cess’ seemed likely to contain positive and definite suggestions 
for the aggressive man, and ' death ’ and ‘ danger ’ to be more 
full of definite suggestions to the weaker subjects. 'Opponent' 
offered the concrete situation of personal contest, and ‘ com¬ 
pany,’ being adapted to so many possible meanings, seemed 
suited to the purpose of tincovering the readier tendencies in 
the mind of the subject. 

Apparatus. The use of a lip key or similar recording device 
in circuit with a chronoscope was soon found unsatisfactory 
on account of the frequency with which the subjects tended 
to make lip movements, or even to begin to vocalize, before 
they were actually ready with a response. Whenever this 
occurred, it meant not only that the time record was spoiled, 
but that tlie stimulus word could never be given to that sub¬ 
ject again under the original conditions. Moreover, oral 
presentation of words proved somewhat unsatisfactory on 
account of the possibility of slight misunderstandings, and the 
slight variations in emotional suggestion on tlie part of the 
expevinientev, The apparatus finally constructed is shown in 
the accompanying picture. 
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It cDiisists of two main parts, tlie timing apparatus and 
the exposure l)ox. The lirst of these consists of a standard, 
a pendulum, anti a graduated metal arc, The standard is 42 
inches high and supported by a base, The pendidum is a 
metal rod, 40 inches long, and is attached 10 inches from one 
end to the top of the standard, The shorter end of the pen- 
diiltim is weighted so that it will make a half swing in exactly 
one second. The metal arc is one-lifth the Iciigtli of tlie cir- 
cLiniference of the pendulum swing. It i.s attached to the 
standard, one half on either side, just hack of the path of 
the end of the pendulum. The arc is graduated so that time 
may be measured to within 5 liundrcdths of a second from 
the pendulum .swing. 

The exposure box is 10x12x20 inches and is closed except 
for a 2x4 inch opening at one end and a 1x2 inch opening at 
the other. From a revolving spool, attached just above the 
smaller opening, a sheet of paper 2 inches ^Yide and 70 inches 
long extends to another similar spool just under the opening. 
The ])aper may be wound from one spool to another by means 
of handles attached to the spools. A piece of metal fits over 
the paper in front of the opening of the box so that it excludes 
all light. The stimulus word.s are arranged about an inch apart 
on the strip of paper, and by proper adjustment of the spools 
any word may be made ready for the exposure which is to 
result from the clo.sing of the light circuit. For this purpose 
two 6 candle power lights are provided, one at either side 
of the larger ojicning of the box. These are wired in series 
with a battery and connected with the catcli which suspends 
the pendulum in such a way that the moving of the catch to 
release the i)eiidulum closes the light circuit, and thus exposes 
the stimulus word to view, 

The subject sits witli his eyes close to the larger opening 
of the exposure box, looking towards the paper about to be 
exposed at the other end of tlie box when the light connection 
is made. When the lights are not on, the'box is dark, and 
the word on the jiaper is therefore not visible. The subject 
is given instructions to look for the word that is to be ex[)osed, 
and to respond as quickly as he can with the first word that 
he can associate with it, A second experimenter watches the 
pendulum, and l)y noting the position of the pendulum on the 
graduated arc at the moment of the response, be is able to 
record the time to within 5 hundredths of a second. 

The two sources of ciTar in deterniiiiiiig word reaclion lime 
by this method are; (1) the auditory reaction liinc of the 
second experimenter and (2) llie error.s in reading Ihc swing 
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of the pendulum from the graduations of tlie arc, The first 
of these is probably very nearly constant for the same experi¬ 
menter throughout a series of observations. The latter error 
may be in either direction but is seldom more [ban 5 hun¬ 
dredths of a second. In general the time records here pre¬ 
sented are a small fraction of a second too long. But as this 
tendency is constant in all the records, and the method offers 
the subject no possible way of stealing a march on tlic experi¬ 
menter, it seems highly satisfactory. 

The results of the association experiment are .set forth in 
Table V. 

The six stimulus words are indicated in the ho]-izoiital line 
at tlie top of the table. Each subject's responses to the six 
words are given after liis initials. Just above each of the 
response words is a large number on the right which indicates 
the time record in hundredths of-a second. The small Jiumber 
just above the response word shows the frequency with which 
that response was given when the experiment was repeated 
with 78 subjects. Twenty-two of the original twenty-six 
subjects were available for this experiment. The upper part 
of the table contains the results for the eleven very aggressive 
subjects, and the lower half the results for the eleven least 
aggressive ones. 

There is evidently ^ significant difference between the two 
groups in the character of the words chosen. In response to 
the words ‘enterprise’ and 'success' the aggressive subjects 
cire almost always definite and positive. Of their twenty-one 
responses fourteen are decidedly colorful;—‘ initiative,' ‘ push,’ 
'money' twice, ‘activi^,’ ‘scheme,' ‘undertake,’ 'ambition,' 

‘ ixjwer,' ' gain,’ ‘ win ’ twice, ‘ wealth ’ and ' advance.’ Five 
responses were sufficiently general to be classified as of doubt¬ 
ful significance;—' building,’ and ‘ business ' four times. One 
was apparently based on verbal similarity;—‘ success ’—' suc¬ 
cessful.' Only one response;—‘failure’ was negative. The 
twenty-two responses of the eleven least aggressive men to the 
same two words were strikingly different. Only three were 
positive and colorful;—‘work’ and 'ambition,' tlie latter oc¬ 
curring twice. Twelve are doubtful, colorless, or- passive;— 
‘physics,’ ‘American Magazine,' ‘oil,’ ‘friends,’ ‘good,’ ‘col¬ 
lege,’ 'happiness,' ‘business’ four times, and ‘industry.’ The 
negative response;—‘failure’ occurred four times. Briefly, 
there, is four times as much probability of a, definite, forward- 
looking response to 'enterprise' and 'success' from the ag¬ 
gressive man as from the unaggressive. Furthermore, there is 
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TABLE V 

AtasT Aggressive Sudjects 


SiimuliJa Words 



Company 

Enterprise 

Opixmcnl 

Success 1 

Danger 

Dealli 

Name 

C.N. 

5 .l(K) 

iirmy 

I 14(1 

inilialivtt 

1 2(X> 

bnx 

1 200 
power ' 

34 150 

fear 

1 275 

cotton 

ZJ. 

I 220 

balicry 

2 175 

liuilcliiiR 

2G 135 

enemy 



1 t 135 

living 

A.C. 

3 200 

Rirl 

22 1(13 

business 

* 1 255 

IMililics 

2 170 

moficy 

2 95 

tirend 

33 175 

lifs 

R.M. 

1 lf)0 

rricnrily 

1 1!10 
push 

2 400 

hatred 

2 135 

gain 

34 100 

fear 

, 33 130 

life 

N.A. 

3 200 

girl 

2 NO 

money 

2 ira 
opposite 

3 200 

win 

34 135 

fear 

3 140 

die 

J.G. 

2 100 
people 

1 130 

aclivily 


1 las 
wcallh 

. 34 135 

fear 

11 230 

fear 

E.D. 

2 200 

1 uloiie 

, 1 310 

1 scheme 

26 200 
enemy 

3 210 

win 

2 150 

dread 

33 115 

life 

H.W, 


' 2 too 
undertake 

7 95 

foe 

I 200 

successful 

' 34 OS 

fear 

2 135 

dcnlli 

M.C. 

2 210 

I business 

22 03 

husinesa 

1 300 

war 

1 250 

advance 

34 175 

fear 

11 340 

fear 

A.J. 

1 130 ' 

insurance 

22 130 

business 

26 195 

enemy 



33 155 

life 

E.L. 

2 135 1 

sociely | 

4 ISO 

nmbilinn 

1 130 

adversary 

25 135 

failure 


133 100 

life 

Lkabt AauDPiiatVK Sviijects 


H.M. 

1 ’ 145 , 

Rood 

22 NS 

Uustnesa ' 

26 155 

enemy 



2 155 

1 grave 

JJ. ' 

2 150 

people 

1 160 
cnlcrpriac 

26 leo 

enemy , 

2 130 

happiness 



E.R. 

2 120 
group 

4 140 

amI}>lioii 

0 160 
righL 

2 200 
succeed 

HH 

11 140 

fear 

W.P. 

3 100 

girl 

1 2B0 

oil 

2 ns 

roolSall 

1 1-10 
college 

1 135 

money 

1 115 

killed 

N.F. 

2 115 

alone 

1 -195 

encounter 

2 100 
antagonisL 

5 300 

business 1 

2 430 

ncL 

2 130 

bivLh 

r.D. 

2 200 
man 

22 235 

business 

3 200 

man 

2 240 1 

good 

2 150 

red (lag 

1 150 

man 

J.N, 

5 200 

army 

1 400 

work 


25 95 

failure 

1 320 

enemy 

33 160 

life 

G.D. 


3 135 

induslry 

9 150 

Iriend 

25 150 

failure 

1 300 

fly 

33 100 

life 

R.B, 

6 230 

friends 

22 230 

business 

26 140 

enemy 

i IflO 

friends 

34 95 

fear 

3 285 

funeral 

S,I1, 

G 105 

friends 

1 250 

failure 

B 130 

friend 

25 115 

failure 

34 145 

fear 

33 120 

life 

n,T. 

1 400 

Ford 

4 330 

amlyilion 

1 300 

Jianiwarc 

1 240 

physics 

34 160 

fear 

1 190 

accitJenl 
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only one fourth as much probability of his giving a negative 
response, such as ' failure.' 

Almost as clear cut is the difference in'the character of 
the responses of the two groups to the words ' danger ’ and 
' death,' In this case the aggressive responses are mostly very 
general and commonplace, while those of the unaggressive 
are more concrete and vivid. Of the twenty-one responses 
of the aggressive subjects only three seem to indicate any¬ 
thing resembling a vivid, personal‘experience, These words 
were 'car' and ‘dread,’ the latter occurring twice. The 
response ' cotton ' to the stimulus word ' death ’ is doubtful, 
and the remaining seventeen are either so common as to be 
meaningless, or else are mere vei'bal variations of the stimulus 
word;—'life’ five times, ‘fear’ seven times, ‘safety,’ ‘die,’ 
'death.' By contrast, the unaggressive subjects present at 
least 10 out of 22 responses which are colorful and suggestive 
of personal interpretation;—‘money,’ 'fly,' ‘act,’ ‘enemy,’ 
‘red flag' twice, ‘grave,’ ’killed,’ ‘funeral,’ 'accident.* The 
remaining twelve are either doubtful or merely verbal;—‘ life ’ 
four times, ‘ fear' four times, ' safety,' ' birth,’ ‘ mau,’ and 
' death.’ In short, the probability of a definite and vivid re¬ 
sponse to the words * danger ’ and ' death ’ is four times as 
great for the unaggressive man as for the aggressive man, 
The responses to ' company' show exactly twice as many 
military, sexual, and commercial associations for the aggressive 
as for the unaggressive subjects. 'Army ’ and ' battery ’ in 
the aggressive list are to be compared with ' army ' once in the 
lower list; ‘ girl' occurs twice in the upper list to once in 
the lower list; and ‘business* and ’insurance’ in the upper 
list are to be compared with ‘Ford’ in the lower list. The 
evidence, which is slight, points to the conclusion that ag¬ 
gressiveness doubles the probability of a definite and energetic 
response to the word * company.* 

The responses to the word ‘opponent’ are extremely diffi¬ 
cult to interpret, and seem to show such an influence of the 
language habit that the word is probably not a suitable one 
for giving scorable results, The aggressive responses ;—' box,’ 
'politics,' ‘hatred,’ and possibly 'war’-are more pointed ex¬ 
pressions of personal antagonism than any of the words in 
the unaggressive list except ‘fight;* but 'football' and 
' hardware ’ leave considerable doubt, and both lists contain 
a high per cent of merely verbal associations. 

Confining our statement of the results to the five words 
which afforded the most definite responses, we may say that 
the very aggressive man is four times as likely to be positive 
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and definite in liis responses to ‘enterprise’ and 'success/ 
twice as likely to give an energetic type of response to ‘ com¬ 
pany/ and only one-fourth as likely to respond definitely and 
vividly to ‘ danger ’ and * death ’ as the very iniaggrcssive man. 
These differences arc large enough to warrant tl:e use of the 
word responses as one of the minor scoring elements in a 
measurement of aggressiveness. 

The time records for the responses show a marked differ¬ 
ence for the stimulu.s words ' danger ’ and ‘ enterprise/ Other¬ 
wise the average differences for the aggressive and the un- 
aggressive groups are less than half a second. For ‘danger’ 
the uuaggressivc subjects take an average time of 2.31 seconds 
as compared with an average time of 1.26 seconds for the 
aggressive subjects. For ‘enterprise’ the unaggressive sub¬ 
jects average 2.55 seconds and the aggressive subjects 1.54 
seconds, Failures to respond arc not here reckoned in aver¬ 
aging the time, for the reason that such failures were due 
to imperfect exposure of a few words in the early part of the 
experiment, 

Seven of the unaggressive responses to ‘enterprise’ re¬ 
quired two seconds or more, as compared with one such case 
among the aggressive subjects. Likewise six of the unag- 
gressive subjects required two seconds or more to respond to 
the word ' danger,’ as compared with one such case among 
the aggressive subjects. This difference is not due to the 
greater average quickness of response of the aggressive sub¬ 
jects, as their averages for the remaining four words are 
actually about a fifth of a second slower than the correspond¬ 
ing average for tlie unaggressive subjects. Apparently it is 
due to some peculiar relation of the two words to the two 
classes of subjects. The obvious assumption in regard to 
' danger ’ is that it comes near to awakening true emotional 
disturbances, much more nearly so in the unaggressive sub¬ 
jects. Their slowness in responding to ‘enterprise’ might be 
due either to emotional inhibition or to paucity of ideational 
material, either a matter of self reproach or of an unlamllvav 
concept. Whatever the theoretical explanation, the time record 
of the two groups of subjects is large enough and constant 
enough to justify its use in differentiating the two types of 
individuals. 

Conclusion 

We are now ready to propose a method,of scoring aggies- 
sivenes.s on the basis of our tests. In order to have a perfect 
record on the trait, a man should be able to maintain perfect 
control of his eyes in the interview test i he should withstand 
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with comj)lctc success all the three types of distraction; and in 
the association tests he should respond deliiiitely and positively 
to 'enterprise,’ ‘success,’ and ‘company,’ and indefinitely to 
'danger/ and ‘death;’ moreover, his reaction time to ‘enter¬ 
prise’ and 'danger' should not be noticeably longer than his 
normal word reaction time. The scoring metliod proposed 
malces deductions from 100 points for each failure of a sub¬ 
ject to meet satisfactorily the four types of requirement just 
mentioned. Corresponding to the relative importance of the 
different tests for this purpose a maximum possible deduction 
of 50 points is allowed for eye movements in test I, a maxi¬ 
mum of 25 points each for the distraction and association 
tests. Stated more in detail, the scheme of dedvretions for 
each type of failure is as follows; In the interview test 5 
points are deducted for every movement up to ten movements. 
The maximum deduction is therefore 50 points. For the 
staring distraction record two points are deducted for each 
second of time increase in excess of three seconds above his 
normal adding time. The maximum deduction allowed is 10 
points, For the shock distraction 2 points are deducted for 
every second of time increase in excess of five seconds. The 
maximum deduction allowed is 10 points. For the snake dis¬ 
traction test 1 point is deducted for each second of time in¬ 
crease in excess of seven seconds. The maxiinimi deduction 
allowed is 5 points. In the word association te.st 2 point.s 
are deducted for each negative response to ' enterprise,’ ^ .suc¬ 
cess,' or 'company' and for each vivid, personal type of 
response to ' death ’ or ' danger.’ One point is deducted for 
each colorless or doubtful response to 'enterprise,' 'success' 
or 'company.' The maximum deduction on the basis of the 
word content of responses is thus 10 points. For the time 
of response to ' enterprise ’ and ' danger' 1 point is deducted 
for every fifth of a second in excess of two seconds. The 
maximum deduction allowed on this account is 15 points. 

The score of any individual subject in aggressiveness is to 
be obtained by totaling his deductions and subtracting the 
amount from 100 as shown in table VI. On this basis the 
scores of our thirteen niost aggressive subjects are as follows: 
C, N. 97, Z. J. 100, A. C. 79, R. M. 94, N. A, 98, J, G, 86. 

E, B. 83, B. W. 100 (lacldiig word test), R. W. 93, H. C. 

98, A. J, 97, E. L. 84, D. R. lOO (lacking tlie word test). 
The scores for the thirteen least aggressive sul)jccts are as 
follows: H. M. 35, J. J. 79,'E. R. 55. W. P. 60, N. F, 59, 
P. G. 72 (lacking word test), F. B. 36, J. M. 81, G. D, 6,F 

R. B, 37, S. H. 88, R. T. 61, B. R. 38 (lacking word test). 
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TABLE VI 

Final Scores of 26 Subjects 
Most Aggrc^ive 



Eye 

Movement 

Staring 

Shock 

Snake 

\^’'o^ds 

Time 

Score 

C.N, 




2 

1 


97 

Z.J. 







100 

A.C. 

io 




i 


79 

R.M. 

5 




1 


94 

N.A. 


2 





98 

J.G. 

5 


2 

4 

3 


86 

E,B, 


6 


1 

4 

6 

83 

B.W. 





x 

X 

100 

R.W. 

5 




2 


93 
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The average score of the aggressive group is 93 and that 
of the unaggiessivc, is 58.8. None of the aggressive subjects 
score less than 79, whereas nine of the least aggressive make 
less than 64, and one of tlie others is incomplete. Three of 
the twenty-six subjects, J. N., S. H., and J. J. appear as 
iioticealile exceptions. It is the opinion of the writers, based 
on considerable acnuaintance with the subjects, that the error 
in regaVd to at least two of them lies in original personal 
ratings rather than in the linding of the test, In any event 
we seem to be justified in stating that there is hardly one 
chance in twenty-five that a man weak in aggressiveness would 
score as high as 85; and there is almost no chance that a 
very aggressive person will score lower than 70, The writers 
believe that this test approximates a true measureincnt of 
aggressiveness more nearly than does the Army Alpha exam¬ 
ination approximate the measurement of intelligence. 
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Moreo-ver, the test can be given in modified and abbreviated 
form with no further equipjnent than a stop watch and a 
set of addition tables, with the additions all made according 
to the specifications in test II. In this case it would be neces¬ 
sary to omit the shock and snake distraction tests; also to 
give the words for the association test orally, and to time 
the responses with a stop watch. The loss of two of the 10 
point tests can be compensated for in the scoring by adding 
25% to the total of the deductions made on the basis of the 
remaining tests. 

Aside from the time required of each individual subject for 
practicing his 50 additions with the tables, the actual lime of 
administering the abbreviated form if the test should not be 
more than three minute. The longer form with apparatus 
requires about seven minutes per subject. 



THE BEDAUX-UNIT PRINCIPLE OF INDUSTRIAL 
MEASUREMENT 

Its Oiugin, Its Laws and Applications 


By Charles E. Brdaux 


(This article is copyrighted by the author, and reproduction in any 
form is forbidden except by his express permission.) 

Ever since industry readied the tremendous proportions 
afforded by the mechanical era, the need has been felt for a 
system of measurements permitting the exact determination 
of the quantitative value of the human physical effort. 

It is due to the lack of such a system that to-day we meet 
deeply set differences between management and labor. Either 
side ignoring the value of a given effort made it possible for 
the employee to practice, undetected, a restraint in production, 
while the employer, in some instances, protected by the same 
ignorance, has been able to arbitrarily decrease the money 
value of the operation performed. 

A correct system of measurement of the industrial effort 
has many applications; 

1. It permits a protective and adequate system of remun¬ 
eration ; 

2. It gauges the capacity of the human being or of a group 
of employees comprising one department, permits an exact 
comparison between departments, between plants, and auto¬ 
matically indicates temporary or permanent conditions that are 
conducive to failure ^ 

3. It maybe used as a basis for apportionment of the over¬ 
head burden; 

4. It allows an automatic and constant comparison between 
the standard and actual labor cost; 

5. It renders scientific planning and scheduling of manu¬ 
facture possible; 

6. It is the only foundation on which any form of labor 
representation in shop management may stand. 

The exponents of the piece-work system have recognized 
that the basic weakness of their method lies in the inability 
to guarantee the rate set, as it is based on the monetary value 
of labor, a commodity which fluctuates. To guarantee the 
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rate is to expose the maiiiifacturei' to failure, iu case of a gen¬ 
eral decrease in the labor market. To cut the rate destroys 
the confidence of the working man and comijcls n restraint 
in production, 

The monetary value of labor, being a variable, cannot be 
used as a means to measure industrial effort. 

Hecausc of fluctuations in this value, not only l3et\veen 
periods of depression or growth, but also within each period, 
among the various classes of labor, it has been impossible 
for the iiiaiiLifacturer to gauge the respective jn’odiictivc ca¬ 
pacities of his various department.s, or of hi.s entire jjlant, in 
com[)arison with a competitive or co-operative institution. 

The result has been that many plants, sincerely believing 
that their productivity rate was high, have failed because of 
their error, the detection of which was impossible without an 
adecpiate system of measurement of the human eliort applied 
to industry. 

It is also because of the absence of such a system that the 
monetary value of productive labor has been recorded for cost 
purposes by the taking of the time of the beginning and the 
ending of each operation. This performance is generally in¬ 
accurate. or, when accurate, necessitates waiting time for 
recording—a waste of labor, both in the productive and in the 
clerical forces. 

To that source also must be traced the erroneous di.sti ihu- 
tion, too often met, of the overhead burden, wherein an 0 ])era- 
tion costing one dollar ($1.00) in productive lalior, performed 
on a machine worth one thousand dollars ($1,000.00) and 
depreciating in twenty years, for instance, wnll be charged with 
the same aEiiouiit of overhead a.s an operation also costing nm; 
dollar (5)1.00) in jtroductive labor, but performed on a machine 
the cost of which is one hundred thousands dollars ($100,- 
(X)0.00) with a rate of depreciation tliat-Tnust be absorhecl in 
ten years. 

Because of the lack of an adequate system of measurement, 
incapable operators have been kept in positions that have l)ecii 
refused to men who were best indicated to hold them: jnn- 
motion has been arbitrary and illogical, thus entailing losses 
to both capital and labor and creating a state of mind on 
either side which is wholly destructive. 

Port Tn‘0 

For many years we have seen the need nt a unit of nieas- 
iirc and our study first led us to determine that such a system 
could not be based on monetary values which fluctuate. We 
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then established that industrial effort was surrounded by two 
constants, i.e,, man and time. 

While the pioductive value changes with every human being, 
the average power of a large group, taken in different gen¬ 
erations, remains constant, the variations being caused by 
difference in facilities and not in men. 

Time is, of course, also a constant. It therefore appeared, 
on first consideration, that time could be used as a unit of 
measurement for industrial effort. 

We experimented with the use of these two factors and 
found that the function we call “ industrial worlc ” is com¬ 
posed of three elements, i.e., effort, i-est and uimvoidablc 
delays. We first established a system based on the element 
of effort alone and found it impractical, because erroneous. 
It brought us to determine that the percentage of rest to effort 
varies according to the nature of the operation. 

Further studies brought us to formulate these two laws; 

1. For a muscular effort •of a given potver, the duration of 
work and rest periods is inversely proportional to the rapidity 
of the motion, and 

2. For a muscular effort of a given poivcr, the percentage 
'of rest is directly proportional to the rapidity of the motion 
and completion of the 'cycle. 

By the first law it is meant that the more, rafjid the motion 
and the shorter the cycle, the more often the ^rest periods must 
be repeated. For instance, it has been found that marching 
iu the army gives best results with fifty minutes’ effort and 
ten minutes’ rest, while in an operation requiring fast motion 
of the fingers, such as packing of very light packages, in one 
instance, the best results were obtained with routine three 
minutes’ work periods and one minute’s rest periods, although 
the percentage of muscle relaxation to muscle strain is actually 
greater than one to three. 

The practice of setting definite rest and work periods to be 
observed by labor is not to be recommended except in rare 
cases. When they are considered it must be remembered that 
man, who as an average is a constant, as an individual offers 
a wide range of variation in power as well as in skill, 

By the second law it is meant that the shorter the opera¬ 
tion and more rapid its motion, because of light weight and 
scarcity of varied movements, the greater the percentage of 
rest must be. 

We further found that a worker, perforjuing a long opera¬ 
tion, had a greater opportunity to increase his efficiency by 
combination of moves than is permitted to one having to 
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perform an operation the cycle of which is short, therefore 
deiiianding a positive routine of a few movements, 

On llie strength of the above conchisions, oiir next step 
led ns to comi)iic tables of all ratios of rest and unavoidable 
delays affecting the various forms of htinian physical effort 
in industry. We found it to vary from 15% of the actual 
productive time in long cycle IiaiicI assembly ojrcrations to 
150% in mechanical operations, hand-fed, of a cycle of two 
seconds or less. 

Experiment.s, analysis and practical exiXM'iencc Irorn out of 
various applications of the above brought us to formulate a 
third law, 

3. In a large (jrotif> vf cijually Ira’nicd ivorkcrs flic average 
{'roduclioH of the tcnlh of the lolal number that is ablest does 
not exceed flic double of the oi'crage frodurtioii of flic balance. 

The securing of the above information allowed us to estab¬ 
lish the Bedaux Point System of Indu-strial Measurement. 
T/ic unit was caffed a " Point." /t has the fof/owing definition: 

A point is a fraction of n- miniile of work, plus a fraction 
of a yni)nitc of rest, the aggregate of which is always one 
minute, but the proportions of which vary according to the 
nature of the operation. 

An employee, man or woman, taking advantage of the nor¬ 
mal amount of rest, produces therefore sixty j)oints in one 
hour, this being tlie standard. An oi)ciator producing more 
than sixty points per hour Is, at the end of the day, entitled 
to a reward based on the difference between the total points 
produced and the standard of .sixty points {)cr liour. 

The operator, by application, can increase his production 
beyond sixty i)oinls per hour without fear of .suffering an 
arbitrary decrease in his reward. The point value of his 
operation or operations, being based on time in relation to 
average human ])hysical energy, two elements that are con¬ 
stant, is not, therefore, subject to change. To l)e logical, the 
inaiuifacturer must guarantee the point value of any opera¬ 
tion, as long ns the said operation is not changed in process 
or material. 

The exact laiowledge of the number of points produced per 
hour by each man allows an intelligent system of ju'omolion 
and the exact knowledge of the number of points produced 
per hour by a group of men or department permits an adcciLiate 
remuneration of the leader or foreman. This protective sy.s- 
tem of reniuneralion based on the point is known as “ The 
Point System of Graded Remuneration.” 
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Part Three 

The logical industrial enterprise is one which inanufacturei 
an article or articles in normal demand, made by norniai 
men, performing \inder normal conditions. 

The rest and delays allowances figuring in the eslal)lisli- 
nient of a point representing normal conditions, the aggre¬ 
gate q{ the elements forming a point representing one min¬ 
ute, the logical Jiianiifactiirc must be profitable at a production 
of sixty points per hour. 

Whenever operators produce more than sixty points per 
hour, the difference must figure in the element of reward of 
the operator and of those directly comiecteci with production 
and whose co-operation labor seeks, with a view to secure 
the maximum production. 

The gain of the manufacturer is realized in tlie reduction 
of the overhead burden per unit. 

The industrial enterprise which finds any or all of its de¬ 
partments producing daily at a rate of less than sixty points 
per hour knows it is in danger and can therefore take imme¬ 
diate steps to bring the point hour to sixty or liigher in any 
or all of its departments. 

Manufacturers having branch plants can compare the point 
hour of each plant each day and thus measure the advance 
of the various units of their enterprise. 

The aggregate point value of an article represents the stand¬ 
ard labor cost. The accumulation of all the jioints charged 
to a given factory order allows automatic comparison of the 
actual cost against standard cost, this witliout the expensive 
recording of the time of beginning and ending of each 
operation, 

The unit of measurement of the Bedanx system, the point, 
can be used in the distribution of overhead burdcu by deter¬ 
mining in advance the cost of running one point through each 
manufacturing unit and multiplying this cost by the point 
value of all operations passing through, thus giving an exact 
overhead distribution. 

Countless efforts have been made in the past to plan, sched¬ 
ule and dispatch material through manufacture. Many fail¬ 
ures have resulted, for it must be remembered that planning 
is a relation of requirements to capacity. 

To determine the time requirements of an article jiasscd 
through different branches of manufacture, or to determine 
the lime capacity of the various branches of niaiuEfacture 
through which the article is to'be passed, one must have at 
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his disposal a unit of measure, which, in industrial effort, has 
heretofore been unknown. 

AVitli the Point, ptanning becomes an easy matter. The 
poijit value is known on every article in all its operations, 
The point capacity of all machines or branches of maiuifac' 
tme is known through the point hour. The work of planning 
thus becomes simply a routine detail rchilion of point value 
(o point hoLii'. 

Part Pour 

Plans of profit-sharing have been established in the past 
with a questionable degree of success, only because there has 
been no way to measure the capacity of each Individual when 
determining tlic share of the profit to which he was entitled. 
If the manufacturer sincerely desires to make his labor share 
in the profits, the amounts can be apportioned according to 
the point hour of each man in relation to his class of skill, 
which is gauged by his hourly rate. 

Various forms of labor representation in shop inanageincnt 
Jiave lately Ijeen widely praised as the logical panacea for 
industrial ailments, but is it logical to organize a labor repre¬ 
sentation which is formed indifferently by men who are capable 
Or incapable? Has it not always been the rule for man to 
.master the capacity to perform before he assumes the capacity 
to advise? Tlie point hour record of each man in his daily 
labor togethci’ with his iiienlaJ capacity .slionld alone determine 
his eligibility to representation of his fellow workers, when¬ 
ever tlie manufacturer feels that he must adopt that form of 
management, 

The most formidable obstacle to overcome in establishing 
industrial peace is the present restraint of hope cau.sed by 
the industrial structure of to-day. The "bench man remains 
a bench man. A press operator, an inspector, an automatic 
screw man, a lathe operator, all remain what they are. It 
has been so customary for industry to endeavor to keep a 
man whei’ever he is doing "fairly well" that labor itself has 
lost the thought of possibility of individual rise but in turn 
has reached a state of mind generally indifferent or else bitter 
and antagonistic. 

Under the Point System of Industrial Measurement, an 
unskilled laborer wlio, by application, shows a point hour of, 
say, ninety, or thirty points above standard, this for a period 
of a year, is automatically entitled to a better position when¬ 
ever there is a vacancy and he can begin such at a point hovir 
of not less than sixty. If, by further application, he brings 
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himself, in this new and better position, to a point hour of 
ninety and maintains himself there, again he is automatically 
entitled to a still better position, at a higher hourly rate, pro¬ 
viding he can begin his performance, through previous study, 
at a point hour of not less than sixty. This can be continued 
through all the branches to the very head, so that when a 
man is given the direction of a department because he has 
shown fitness in the elemental requirements of the executive 
position, it will be known that he has also proven himself 
capable in all the branches he commands. 

At the present time the labor unions, knowing that the 
chances for advancement in productive labor are small be¬ 
cause of industrial tradition, have endeavored to raise the 
scale of wages of the whole strata composed of the various 
classes of effort, a suicidal move, as if applied it only raises 
the price of the commodity purchased by the consuming class, 
which is largely composed of the class of people to which union 
labor belongs. 

As illogical as this labor demand may seem, there is no 
logical answer to give other than to render possible the ad¬ 
vancement of the individual through each class, according to 
the exact individual capacity, a capacity which to-day can 
be accurately measured by the Point without increasing but 
even decreasing tlie amount of clerical work usually found in 
most plants. 



A STUDY IN INDUSTRIAL PSYCHOLOGY—TESTS 
FOR SPECIAL ABILITIES 


By Ei.sir OscimiN Bhegman 


The lollowiiiK is the report o[ an investigation with the 
purpose of developing tests lor the use of the Employment 
Department o( R. H. Macy & Co., Inc., a large department 
store in New York City. 

The problem re.solvecl itself into a twofold one; first to 
determine whether or not the a])j)licant who applies is of 
normal intelligciice, and secondly, to determine, of the normal 
applicants, the s])ecific kind of work to which they shall be 
appointed. 

The first j)robic]n has been handled in a fairly adequate 
manner by an adniJted form of the Trabue Completion Test. 
The results of ihi.s test will, it is hoped be presented very 
sooji in a separate paper. This report concerns itself with the 
development of te.sts for .specific abilities. 

The greatest number of employees of a department store 
are salcsclerk.s; the next in number are clerical workers. Con¬ 
sequently it wa.s for tests tliat would indicate these two types 
of workers tliat jnve.s(igatioii was first begun. 

It has .seemed worth while, in the light of the iiiany new 
problems of admini.stration which confront the investigator 
in industry, to add to the report of the findings of tlie investi¬ 
gation, an accoLint of the manner in which the investigation 
itself was handled, since this phase is as vital to the success 
of the undertaking as an adequate knowledge of the scientific 
technique and [)roccdure. 

FrcUniiiiarics. In April of 1919 the writer came to the 
department store, whose employees number 5,000 to " ex¬ 
periment with vocattnnal tests." Before heginning experi- 
menta! work of any kind the writer went througli a course of 
training, working in every department of the organization 
in every capacity—as wrapper, salesclerk, complaint clerk, etc., 
etc,, through a miscellany of positions. This course enabled 
the writer not only to understand the organization in which 
she was to work, hut to learn the personnel and personality 
of departments, to have more than a bowfng acquaintance with 
department heads and executives, and, not the least important, 
to have a knowledge of ii.seful kinds of records and of many 
somec.s of information which blueprints and verbal reviews 
did not give, 
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Immediately following this course of sprouts, the writer 
became an active member of the Employment Department, 
interviewed and appointed ax^plicants and during three months 
(during which time an office which couJd he used as a Jabora- 
tory was being built and equipped, and preliminaries to actual 
experimental testing, such as collection and printing of forms, 
etc,, were carried on) acquired a grasp of the local labor situa¬ 
tion, the sources of supply, the types, characteristics and social 
levels of applicants who presented themselves, tlie ways in 
which appointments and judgments were made, etc., etc. 

The following diagram illustrates the office laboratory which 
was built where the testing could be carried on with the mini- 
mum of noise and disturbance. 



a, Examiner’s Desk 

b. Bookcase 


c. Windows 

d. Blackboard 


e. Cupboard 

f. Doors 
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Before the testing; itself took place, meetings of the execu¬ 
tives, heads and assistant heads were called, at which the 
purpose,'i)Ian.s and method of the investigation were disclosed 
and explained as simply as possible, and cooperation was 
urged. Iji ojder to dispel prevalent bugaboos ahoiil the JLitnre 
of mental tests, a live minute Trabue Completion Test was 
given, 

Obtaining the Crilerio. In view of the unfortunate waste 
that ha.s nut infreipicnlly occurred when after extensive tests 
had been nuule, records of work and ability were unobtainable, 
it seemed wise to secure the criteria before testing, the more 
so that some coherent sclieine of rating had to be worked out 
in an organization where for two thousand salesclerks there 
were as many a.s 200 department and section heads. 

Salesclerks. Considering first the salesclerks, two methods 
of determining their ahiliiy were available (1) tlie actual 
weekly sales or production record made by each clerk. (2) 
the opinions of depaiTment heads, of which there are for each 
department 

1. Buyer 

2. Assistant Buyer 

3. Section ^fanager or Floormaii. 

Froilucdun Record. Since the gross amount of sales varies 
for each dei)aiTincnt anci from week to week, according to 
sea.son and we.'ttlK-r. it was not [lo.ssible t'o throw all sales on 
to one scale for all time. The following method was used. 

A simple iyvqiwncy table wa.s made .showing the sales for 
each department for each week. From this the upper and 
lower (jiiai'tile limiLs were determined, and record was made 
for each clerk, whether he sold within the interquartile range, 
above it, or below it. Such a record was kept for ten weeks 
and from this was determined whether a cleric sold character¬ 
istically witliin, iihovi! or below the average range, 

Ratings. 'I'lits information was .supplemented by the rating.s 
of department heads, which were obtained in the following 
jnanner; 

The accom|)anving form wa.s sent to each buyer and assistant 
buyer and section manager. From the information so gained 
it became possible to group the bulk of the selling force into 
three large categories—the good, the poor and the average 


salesclerks. 

Sec. Man. 

To M Buyer Dept, 

IMease send to.of the Employment Oflico. on 


tlii.s form, n<jt later llian. 19.... ll7re<- lisl."; of 





130 


BREGMAN 


employees, carefully made out according to the following in¬ 
structions. 

I, List below the names of as many salesclerks as you know 
who are now employees of R. H, Macy & Co., Inc., and who 
represent, in your opinion, the most capable and desirable type 
of salesclerk. 

Write down only the names of absolutely first class .sales¬ 
clerks; those who really are able to sell. 


No, 

NAME 

Remarks 


























II List below the names of as many salesclerks as you 
know who are exactly the opposite of the people you have 
just named, representing the poorest type of salesclerk with 
little or no selling ability. 


No. 


NAME 


Remarks 








A STUDY IN INDUSTRIAL PSYCHOLOGY 


131 


III. Place below .a list oJ salesclerks who are, in your opin¬ 
ion, neither very good nor very poor; the ordinary type of 
salesclerk who is satisfactory but not exceptional. 


No. 

NAMt: 

Remarks 







, 



















This loose form of rating sheet was used in preference to 
a more rigid and detailed form for the following reasons: 

(1) Tlie (lei>aiTmi.*nl heads of the organization under con- 
sideraliou are to a great degree free agents. It was essential 
for the return of tlie largest number of these sheet?; with a 
mininuiin aniouiU of energy and friction entailed, tliat tlu* 
form he filled mu with the utmost ease, 

(2) The dei):iiTmciU heads are not an academic group— 
the niediem intelligence lower than that of such a group— 
they had consistently shown an aversion to any sort of analytic 
tlhiildiig or |>atiL'nl arrangement of groups ijito rank order, 
and such thinking, if forced upon them would be of a doubtful 
reliability, It seemed on the whole to be wisest to use a 
spontaneous method of rating—the more so that it would have 
been impractical lo test the entire force of salesclerks. There¬ 
fore, l)y tliis method of rating, the testing was confined to 
those individuals who were spontaneously recalled in the minds 
of the several department heads as meriting good, bad or 
indifferent ratings. 

The resnlt-s of Ihi.s method bore out the choice of the course, 
The forms were returned on time and with a mininuini of 
follow up work. The large body of .sale.sclerlc.s was i';ilccl :\n(l 
the undertaking did not lose in prestige by being called super- 
sciciUific, im))raclical. etc. 
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The ixidgmeiits so obtained from these three souices, buyer, 
assistant buyer and section manager were then matched up 
on the following form. 

Department..-.. 


Disc, No, 

NAME 

Siilcs 

Buyer 

Ass't 

□uyer 

Sccliort 

Mannt'cr 

ncmarks 






























1 























1 



































All the ratings were tabulated on this form, Against each 
salesclerlc's name was placed in the appropriate column a red 
check, if called poor, a green if good and a black it average. 
The different rankings were further marked by jdacing red 
in the lower boxes only, green in the upper and black in the 
middle. Finally, under sales in the first column were j)laced 
similar colored checks for the predominant selling tendency 
over the ten weeks, as obtained from the sales recovd.s as ex¬ 
plained above. 

From this final tabulation several groups could be dis¬ 
criminated. 

First, those clerks consistently rated by all criteria ns (/ooil. 

Second, those consistently rated poor. 

Third, those consistently rated as average, 

Fourth, those rated on 'the whole as average but Avitli one 
or more judgments that they were above average. 
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Pifdi, iiiiscc’llaneou.s gronjj.s of individuals about whom there 
was no cojnmon and coiisi.sicnt t 3 ’i>L* of judgment—lliose rated 
as both good Jind iKtor, for inslance. These were wholly 
omiltecl from the ex])erinu*m because of the. inconsistency with 
which itiey were rated. 

Clerical. Tlic other large group of cjuployecs engaged in 
work of gener;dly .similar character were the clerical workers. 

Tor the sunie reasons and in the same fashion as applied 
to salesclerks ratings of the clerical workcr.s were obtained 
previous lo testing tor ihe three large clerical departments— 
the Audit, l!u; Mail (Irtler and tlie Comnlaint Department. 
Unlike the salesclerks, however, there was no common pro- 
diiction record hy svliich the judgments of department heads 
could be controlled, llie clerks being engaged in a multiplicity 
of operations, from cfuiiplicaled .stati.sticai work and bookkeep¬ 
ing, to counting of checks, filing and ccmj)tometer operating. 
Moreover in mo.st cases the clerks were welt known to only 
one person, the local supervisor, tndy .superficially known to 
the actual deparinient bead and very occa.sionally known to 
ns many as three persons. 

Raters were therefore instructed to rate only those clerks 
whom they knew and the rule.s taken at their face value, with 
the precaution that .such clerks about whom 'there was a wide 
divergence of o|)inion w'ere cxchided from the possible sub¬ 
jects for experiment, and (inly such clerks included about 
whom at least two people were agreed. 

The following scale indicate.s the manner in winch the clerks 
were grouped. 

1. Rated as first class hy two or more —no dissenting opinion, 

2. Rated as fir.st hy two—^2iid hy 1. 

3. Rated a.s lir.st hy one— 2jh 1 by 1, 

4. Rated as second hy two—1st'by 1. 

5. Rated as second by two or three—no dissenting opinion. 

0, Rated as third hy one—2nd by 2. 

7. Rated as three by one and 2ijd by 1. 

8. Rated as three hy two and 2nd by 1. 

9. Rated as three hy three or two — no dissenting opinion, 

In obtaining raling.s throughout the course of this work, 
it was noted liiat there was a vei-y marked reluctance to say 
that an employee was third rate or unsatisfactory, for the 
I'castju that the executive giving such a rating laid himself 
open L(i the (jucslbii of why he retained .such a person, It 
seemed fair, therefore, to infer that all clcrk.s whose total 
rating wa.s more than .seven, could lie included among ihe 
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third rate cleiLcs, and they were so considered. This was also 
done because the number nine group alone made np a very 
inconsiderable number. The ratings of good clerks, if iinani- 
moiiSj were significant; of the poor and mediocre clerks, less 
so because of the hesitancy to call any one poor, and of a 
tendency to underrate if the clerk was unknown or doing un¬ 
important work, or if but newly employed. 

However, these ratings, such as they were, served to indi¬ 
cate three groups, the very good (1) the poor (7-9) and the 
generally average clerks who were rated between these Uvo 
extremes, 

Tests. Through the courtesy of Prof. E. L, Thorndike and 
the National Research Council Committee sets of the N. R, C, 
Tests, the precursors of the National Intelligence Tests were 
made available for the purposes of this investigation. 

These te.sts were; 


1. Verbal A which consisted of 

1. Arithmetic 

2. Directions 

3. Sentences 

4. Synonym Antonym 

5. Judgment 

2, Non Verbal A 

1. Picture Completion 

2. Series Completion 

3. Comparison 

4. Symbol Digit 


3. Verbal B 

1. Computation 

2. Vocabulary 

3. Sentence Completion 

4. Disarranged Sentences 
S’. Logical Selection 

4. Non Verbal B 

1. Copying Designs 

2. pictorial Sequence 

3. pictorial Identities 

4. Recognitive Memories 


In addition the following tests were also used, 

^Sentence Completion 10' and 5' time limits—called TIA 
Arithmetic—^Woody McCall Mixed Fundamentals—called 
T2 

Rearrangement of Animals—^An abbreviated form of the 
writer's test published in June, 1918, Journal of Applied Psy¬ 
chology —called T3 
Woodworth Wells Mixed Relations 
Woodworth Wells Mixed Relations changed to an under¬ 
lining test—called T5 
Woodworth Wells Opposites 

Woodworth Wells Opposites changed to an underlining 
test—called T4 

Woodworth Wells—Number group checking 
Woodworth Wells—Cancellation 


'This test is a scale of 25 Trabue Sentences, arranged by the writer, 
for wliicli norms from approximately 20,000 adults are at hand. 
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Tesliny. Dircckians tar ijcrforniing the tests were identical 
for every individual. 

The tests were given to gniiips in the laboratory sketclied 
above. Tlic te.siing was alway.s in the early morning—from 
9 to 10:30 A. M, Meetings did not last longer tlian 90 minutes. 
Subjects were recai!e<l (»ir a second period if the tests were not 

completed in the lirsl. 

Before hegiuiiing any testing, the purpose and method of 
the worlc' wa.s carefullt’ explained to each group as .simply 
as possible. Discussion was perfectly fret and te.sting was 
never begun wiilnjut good feeling and rapport between the 
subjects and tlie txj>erinienter. Pains were taken to disjiel 
any preliminary itcrvoiisness, and to see that subjects took 
the tests coiiiforlably. Polli sexes and all ago.? from 17 to 60 
were represeritcd. Of the salesclerks there were sellers of 
every type of merchancli.si? from upholstery and women’s suits 
to shoes, veiling, gloves and notions. Every piiase of clerical 
work at which the employees of this CsStablishment were en¬ 
gaged was likewise represented in the test groups. There 
were skilled tyjiisis and .stenographers, statistical workers, 
bookkeepers, liilling clerk.s, comptometer operators, check 
counter-s, liler.s, keepers of simple records, etc., etc. 

For tlie initial phase of the experiment, in which a rough 
evaluation of the tests as to their sensitivity to different degrees 
of abilities was sovight, only the extremes of both groups were 
used; that is, of the salcsclerk.s, tho.se were te.sted who were 
consistently cla.s.scd a.s good and as poor; of the clerical work¬ 
ers, tho.se who, according to ihe c1a.s.silJC!ition .scheme indi¬ 
cated above, were classified as 1, and those who fell within 
the 7 to 9 classifications. 

The average workers of each gi'Oiip were made use of in 
a later phase of the experiment. 

Corrclalioi! Ponmila and Stalislical Methods 

Several correlation methods were ii.sed in the course of 
this work. 

1. The method of Unlike -Signed Pairs—discussed in Thorn¬ 
dike's Mental aivd Social Measurements, p. 162, pp, 170-1— 
and called in tabulations and discussions in tliis paper the U 
Formula. 

2. Pear.son Riserial R.—a formula which determines the 

correlation when one variable is measured and continuous, 
the other imnieiisured and alternative—and which closely ap- 
proximato.s the v—- 2xii^ Piomefrika, Vol. VII, 1909, 
p, 96. no-xoy Exy 

v3, Finally the orthodox Pearson »^n^xo-y 
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the last phase o£ the experiment, in partial correlation and 
regression in order to weight the significant tests, When this 
formula was used the value 1 was given to a quality i.e,, good 
salesmanship, and 0 to the absence of it." 

The other formulas do not necessitate so arbitrary an assign¬ 
ment of values. 

Correlation Coefficients — Salesclerks. Table I below repre¬ 
sents the coefficients which were obtained from the salesclerks 
when the good and the poor clerks were tested with a series 
of tests. The number of clerks tested, the names of the tests 
and the statistical method used to obtain the coefficients arc 
all indicated, 

TABLE I 

Good and Pooh Salesclerks 


Number of 
Cases 

Tests 

rbyU 

Formula 

45 

NRC-NVA Total 

— .09 

46 

.. „ .. » .1 #. ^ Picture Completion 

— .39 

44 

" ” “ " " 2 Series Completion 

'■ " '* “ “ ‘‘3 Comparisons' 

+ .22 

44 

— ,59 

44 

“ “ “ " “ “ 3 Comparison 2' 

- .83 

43 

'■ ... “4- Symbol Digit 

-h .25 

44 

“ '■ " " *' ” 5 Form Combination 

— .37 

44 

.. V A Total 

— .59 

43 

r. .. .. 1 jyiath. 

— ,16 

44 

“ *' ..2 DirectioJis 

— .66 

43 

« ir .f M .. 2 Sentences 

— .79 

44 

" " " " “ 4 Synonym Antonym 

— .22 

45 

" “ “ " " 5 Common Sense 

— .79 

43 

'' “ " " " 6 Analogies 

— ,54 

46 

“ NVB Total 

+ .16 

48 

" " '* " “ “1 Copying Dcsij^s 

— ,06 

46 

c. <1 .. « 4t «t 2 Pictorial Sequence 

• -f- .16 

48 

“ “ “ ..3 Pictorial Identities 

.00 

45 

.. “ " “4 Recognitive Memories 

4- .51 

46 

" “ " V B Total 

— .06 

49 

<1 1 . fi M M ^ Computation 

— .16 

49 

.1 1 . .. fc 2 Vocabulary 

,00 

49 

“ " " " “ 3 Sentence Completion 

— ,34 

49 

" “ “ " ’* 4 Disarranged Sentences 

— ,28 

49 

“ " " " " 5 Logical Selection 

,00 

48 

T 1 A Sentence Completion KV 

— .13 

48 

T 1 A Sentence Completion 5’ 

— .37 

33 

• T 2 Arith. 

— .16 

49 

W. W. OpDosiles 

— .16 

47 

T 4 W. W. 0pp. Adapted 

— ,43 

48 

W. W. Mixed Relations 

- ,37 

48 

T 5 W. W. M. R. Adapted 

— .46 

48 

T 3 Rear. Animals 

— .56 


-This method of statistical treatment was suggested by Prof. T. L. 
Kelly, now at Leland Stanford University. 






A STUDY IN INDUSTRIAL PSYCHOLOGY 


137 


Some of these coet'Iicients are markedly high, also they are, 
almost without exceptionj negative. 

Table 11 presents coefficients which were obtained from 
coiiiljiiiing in varioii.s gronp.s the tests wiiicli singly gave the 
highest caenicieius. (The coefficient for NVA3—2’ time limit 
had not been eonipulctl at ihe lime these gvouiiings were made 
and the coerheienis of Table If calcuintccl.) 

Tlie gc'iienil leiirlcin'y, it will he noticed, is to increase the 
correlation coeflicient hy such_ coinhinatious of lests, 

TABLE II 

Good and Poor Salesclerks’ Tests Combined 


Number of 
Cases 

41 

Sum 

Test 

V A 3 N VA 3 — 3' 

r by U 
Formula 
— .66 

39 


** 

" 2-3-5-6 NVA3 — 3' 

- .09 

43 

u 


" 3-5 

— .79 

43 

'* 


2 and 3 

— .84 

44 



" 2 and 5 

— ,78 

42 



" 2 and 6 

— ,56 

44 



“ 2 andN VA3—3' 

— -GG 

42 

11 


" 3 and 6 

— .64 

43 



“ 2-3-5 

-- .84 

42 

n 


” 5 and 6 

—. 51 

44 

** 

** 

■' 5 andN VA3—3' 

— .61 

39 



" 6 and N V A 3 — 3' 

— .75 

42 

14 

** 

" 2-3-6 

— .79 

40 

11 


“ 2-3N V A3 —3' 

— .66 

42 

4 4 

** 

“ 2-5-6 

— .63 

40 

** 

** 

" 2-5N VA3~3' 

— ,66 
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Graphically represented these coefficients take on a more 
concrete meaning'.. 

Let ns consider for a moment the practical implication of 
such a situation as Graph I represents. Suppose that the forty 
odd people represented by the stun of the crosses and the rows 
of dots were, without any distinguisliiiig mark, seated in a 
room. By means of tests which are repie.seiitecl in Graph I 
(using tlie position of the arrow as a reference jDoint) an indi¬ 
vidual would he able to determine which of the group had 
been successful and which unsuccessful as salesclerks, and 
would be in error only 8 times out of the forty-four cases, 
Cleyical. The clerical workers, good and poor, represented 
by classifications 1 and 7-9 were tested with the following 
tests, 

V A—All 

N V A—All 

W. VV.—Cancellation 

\V, W,—No. gr. checking 

Rearrangement of Animals—T3 

Table III which follows presents the coefficients which these 
tests gave, the formula in use being agaiji that of unlike 
signed pairs. 


TABLE III 

Good and Poor Clericals 


Number of 


r by U 

Cases 

Test 

Formula 

59 

NRC-VA 

.34 

61 

... " 1 Arithmetic 

.09 

61 

.. " " 2 Directions 

.00 

60 

“ " " “ "3 Sentences 

.31 

58 

“ “ " " “ 4 Synonym Antonvm 

.28 

60 

” 5 JudKment 

,37 

50 

“ “ •• “ 6 Analogies 

,28 

48 

" “ “ NVA 

31 

52 

“ " ” 1 Picture Comoletion 

.13 

52 

„ ^ Series Completion 

,22 

51 

" '* " " " *' 3 Comparison 2' 

.45 

50 

;;;;;; *'4 symfciDigit 

,37 

52 

5 Form Combination 

.00 

34 

No. Gr. Ch. 

31 

35 

Cancel.. 

— 13 

57 

T3 

.19 
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It is evident jit once that llie ratios are not as Ingh as those 
obtained for llie salesclerks, the higlicsl being .45 for N V A 
3—the Coinpririsoji 'l'esl/‘ However, it is also ijnincdiately 
evident il)at ilic.se raiios are all iio.siiive, wiili ilie one excep¬ 
tion of CaiiCL'Ilalirm. Now it will he. renicinbered that the 
M V A and V A le.'iis were the tests which gave Lhe liigliest 
correliiLions for salesclerks but that these ratios were almost 
all consistcnlly jn 7 /(f//iv. 

It seems fair t<» assume that had it been jiossihle to sccnie 
clei'ica) workers rated with the freedom from error of tire 
saJcsclerJcs' classilicaiinns. and in view of the fact that a jiosi- 
tive relationship i.s indicated by the plus ratios, that positive 
correlations pcrcejitibly higher than those actually found would 
have been obtained. However, this is merely an assumption; 
what is apjiarcnl is the tendency for salesclerks and cler¬ 
icals to j)ull in distinctly oiijiosite directions, so that we have 
a diflerence between trades as distinct a.s the dill’cvcnccs within 
a trade, if not mure so. 

This is a not unim]uirlant consideration, for the primary 
interest of an F-injiloyment Office is not in deciding with what 
degrees of excellency an unknown individtial will perform a 
given task, Imt to decide at what task to place a given 
individual. 

Concretely, Mary Jones, age 18, wilhoul; experience or train¬ 
ing wants a joh. The Employment Manager wants to know 
whether to make Mary Jones a salesclerk or a clerical. To 
him wliether Mary Jones will rank fifth or first as a sales¬ 
clerk is a mailer of academic interest only. How good she 
will be is a matter she must show by performance, since in 
industry as elsewhere reward comes not in anticipation of 
work but follows it. Wages in a large industry are fairly 
standardized at emiiloyment time, and are modified not for 
potential ability but only (or previous experience. They 
become really dilTcremialed for individuals only with the his¬ 
tory of that individtiars work. 

In order to express numerically the contrary tendencies of 
salesclerks and clerical workers, the two groups were thrown 
together and an attempt was made to separate from this hetero¬ 
geneous group those who W'cre called good salesclerks and good 
clericals. 

Such a combination seemed to have two virtues, (1) the 
reliability of llic coefficients obtained would be increased be¬ 
cause the size of the group would he doubled; (2) the hetero- 

®It will be i'eiJicinI)LTftl liinL thi.s lc.M (javc lhe liiglie-st corrclalioii 
coefTicicut, but a ncttalivc one. when used with salesclerks. 
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genity of the enlarged group more nearly approximated actual 
working conditions. Candidates for ciiiployinent as they pre¬ 
sent themselves at the office which these tests were to serve 
are not divided off into sales or clerical workers and often 
have no strong preference for any special kind of work, but 
must be classifi<^ aud selected for various jobs by the indi¬ 
viduals who interview them. 

This coinbination of both types of workers was made in two 
ways, first all sales and all clericaLs were combined, and selec¬ 
tion made, for (1) good salesclerks, (2) good clerical workers. 
The second grouping was as follows. When good salesclerks 
were being selected the unsatisfactory clerical workers were 
omitted from the total group of sales and clericals for the rea¬ 
son that there did not seem to be any ground to consider them 
as undesirable candidates for selling. 

All that was known was that they were undesirable for 
clerical work, Of course it may be argued that the retention 
of the good clerical workers was likewise ungrounded; that 
there was no reason why thej' should not make good sales¬ 
clerks, even if they were good clerical workers, . This is 
doubtless true, At the same time, considering again the prac¬ 
tical aspect, they were actually non-sellers, the negative-posi¬ 
tive correlation findings seemed to indicate that also poten¬ 
tially they might be non-sellers, and it seemed to be of interest- 
to see what would happen to the coefficients already obtained 
when such a group as this under discussion was made. 

When the selection for good clericals was vnade, the un¬ 
satisfactory salesclerks were omitted for the same reasons 
given for omitting unsatisfactory clerical workers when select¬ 
ing for salesclerks. 

Tables IV and V present die coefficients which were obtained 
from this double grouping. The coefficients which were ob¬ 
tained from the original pure sales and pare clerical groups 
are also given for comparison, so it may he seen how the co¬ 
efficients are affected by the increased number of subjects and 
the different kinds of groups. 

Apparently, the elimination of the bad clericals, in the case 
of the selection for salesclerks, was justified, for when good 
salesclerks were selected from the heterogeneous group of all 
salesclerks and all clericals correlations were lower than those 
obtained with the salesclerks only. However when the poor 
clericals are omitted from this heterogeneous group and selec¬ 
tion then made for good salesclerks the situation appears to 
have cleared again, for the coefficients regain their original 
character occasionally being slightly higher or slightly lower 
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than in the original classification. Their significance is how¬ 
ever increased, since their P. E.'s arc decreased, hecaiise of 
the increased size of the group from which they were obtained, 

When good clericals were selected the coinbhiing of all sales¬ 
clerks and all ciolcals doc.s not seem to affect the coefficients 
marltedly, cxccjU to raise them in several instances. With 
the clericals, it will lie remcinbcrcd, tlic \valcr.s were oilgijially 
nnidfJy, so that an addition of .several more jnisplacenients 
would probably Jiot have the same disturbing effect as ndtli 
the salesclerks, ^vliere the original groupings were markedly 
clear. 

However, when from the total group the imsatisfaclory 
salesclerks arc withdrawn and selection tlicn made for good 
clerical w'orkers. the coefficients are, with the exception of 
one case wliei’c the ratio remains practically the same, I’aised 
to a marked degree, and again we seem to have a justification 
for having cxcUulcd the poor salesclerks from this group. 

Not only are tlie coefficients raised Init in some cases they 
become large enough to i)romise a fairly satisfactory basis 
for the selection of clerical workers, something which the size 
of the coefficient.s obtained with the original group of clericals 
only did not warrant. 

Final Phase of the F.rferintcnf. Having, in the manner 
above described, found several tests which seemed sensitive 
to selling and clerical ability', it became nccessavjv, in .order 
to employ these tests for the guidance of the Employment 
Office, to evaluate each test, in accordance with its importance 
ill the grouj) of; tests. In other words, it was necessary to 
determine the regression equation for the whole group of 
tests, and the best weighting for each test in that group. 

Most of the tests however which gave significant coefficients 
were in the group of -the National Research Council 1'csts, 
These tests had been constructed for use in schools and their 
content ivas not especially adapted for industrial use. 

People who are looking for a job usually object to being 
asked who Black Beauty or Thomas Jefferson are and are 
apt to ask in response '* Is this a school we are in?” Even 
if this response is not audible, such questions do not result 
in a very favorable state of mind, and since the success of 
industrial tests is as dependent upon their reception by the 
people wdio take tltc tests as upon the prophetic accuracy of 
the tests themselves, new tests were constructed, in form 
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the.same as certain of the N R C Tests, in substance different. 
The atmosphere savored more of calico, pirns and sealing wax 
and less of George Washington, Abraham Lincoln and the 
states of the Atlantic Seaboard. 

The test questions were all placed on one side of a sheet of 
8^x11 paper, on the reverse side of which was a dotted line 
for the name, and several sample questions of the test itself, 
the samples being of course so simple as to he self-explana¬ 
tory, The questions on the test pAper were arranged roughly 
in an order of increasing difficulty, the earliest questions being 
scarcely more difficult than the sample quc.stion.s. 

A term used by Link, " shock absorber,” expresses a per¬ 
fectly sound principle. Non-academic groups have a very 
strong aversion not only to academic problcm.s, but mental 
gymnastics of any kind, and it is mitch better for the prestige 
of the test to get sucli people started on primer tasks and 
then iinpeiceptibly involved in the more dilTicult tasks, than 
immediately to frighten and make them hostile with tlie more 
difficult questions. 

It was necessary, of course, after the new tests had been 
made to ascertain if they would act in the same way as the 
tests they were meant to replace, that is, give the same char¬ 
acteristic correlation coefficients. 

This called for more testing. It will be recalled that in 
originally getting classifications for the salesclerks and clerical 
workers there were several groups, the very good, the very 
poor, the average, and the slightly better than average. Of 
these groups the extremes, good and poor of both worlcers 
had been te.sted in the original phase of the experiment. The 
clericals and salesclerks who were rated as average had not 
been tested. 

It seemed unwise to test the original groups with the new 
tests, because, having spent some-three hours in test taking 
they had had an amount of practice which made them no 
longer naive, and also because it was inadvisable to take 
those who had already lost a considerable period of working 
time away from their departments for a further period. 

Consequently the new tests were standardized on the group 
of untested workers, those who made records of average clerks, 
or in some cases somewhat better, but who were neither abso¬ 
lutely first rate, nor third rate workers. One hundred sales¬ 
clerks were tested and 43 clerical workers. 
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The new tests were iiKuli'lications of tin; N R C Common 
Sense— called iti ihc Tallies T 9, N R C Directions—T 8, 
N R C Comparison—'J' 13, N R (' .Seiutiice.s—T 12. Iii 
addition Coinjiletimi lest T 1 A,—10' time limit—was used, 
the adapted form of \\ iiodworlh Wells Mixed Relations— 
T 5, and the Animal Uean-aiiKemeiit Test—T 3. 

Tlie formula whicli was first used to evaluate these tests was 
the Pearson liiserial r. tin* clerical worker.'?,'* 43 in iiuinhcr 
being' con.sidercd the .Sjn'ci;i) groii]) aiifl the 100 .sale.sclerlc.s 
being considered no»t-cleric;il workers. 

The coefhcienl.s obtained with liicse lusts and this group 
of workcr.s is given below in Table VI. 


TABLE VI 


Test Pearson Biserial r Number 


T lA 

Completion.. 

.19 

143 

T 8 

Directions... 

.63 

143 

T 9 

Sentences. 

.45 

143 

T 12 

Judgment. 

.55 

143 

T13 

Comparison... 

.74 

143 

T 3 

Rearrangement of Animals. 

.11 

143 

T S 

Mixed Relations..... 

,51 

143 


With llic excejdion of T 3 and T 1 A the coefficients are 
high and the performance of the two groujis, sales and clerical, 
is consistent with the performance of the groups previously 
tested, the salesclerks giving low scores, the clericals high 
scores. 

T 3 and T 1 A could therefore be omitted frojn any final 
group of tests. It was decided, in spite of tlie size of the 
coefficient of Test 5, which is W. W. Mixed Relations, to 
leave it out of consideration also, because of the difficulty 
always encountered in explaining the task and having it under¬ 
stood by tho.se tested. With the other tests it was simply 
necessary for tlie subjects to see and do the sample problems, 
without other explanations Iroin the experimenter. For the 
sake of economy in time and eflfort in the administratioti of 
the tests, when they should be used as part of the employment 
process, it sccnicd wise to discard this test, which had to be 
explained to th e majority of .subjects. _ 

* It Wii-s at tlic time inipo.'ssiljtu (o test more eletical workers because 
of (he Clirislmas season nish. 
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The next step was to find the regression equation for the 
group of tests which were retained and the best weighting for 
each test. 

The formulae in partial correlation and tests weightings are 

2xy 

derived from the Pearson coefficient The co¬ 


efficients in Table VI are those of the Pearson biserial r, which 
closely approximates this r, but which is not identical with it, 

2xy 

As stated previously, the values for the new tests 


■were found by giving the presence of sales ability the value 1, 
the absence of it or as was actually the case, the presence of 
derical ability the value 0, the test scores forming the values 
.of the second variable. 

The regression equation was thus determined for 4 variables 
and the criterion, the variables being the scores in the Direc¬ 
tions, Comparison, Judgment and Sentence Tests. The weight¬ 
ing of the Sentence Test however was so very inconsiderable 
that it was deemed inadvisable to retain it in the group and 
icohsequently a second regression equation was calculated in 
which there were only 3 variables and the criterion. 

The following regression equation was obtained using the 
variables; 


X.l The criterion — 

X2 Comparison T^t — 

X3 Direction Test — 

X4 Judgment Test — 

X,= .025X,-f- .065X3— ,0Q7X,— ,85* 
R for this equation =. 63 
Biserial r = .74 


The manner in which, by weighting the tests in accordance 
with the regression equation above stated the division between 
the two groups, sales and clericals is emphasized is indicated 
by the following graphs. 

Graphs 2 , 3, 4 represent the performance of the sales and 
clerical groups in single tests—T 8, T 12. T 13. The tendency 
for clericals to do better work is evident to some degree. A 
great number of misplacements would occur however if esti¬ 
mates of ability Avere made by these graphs as tliey stand. 


“ Tills equation is expressed in gross scores. 




A STUDY IN INDUSTRIAL PSYCHOLOGY 


147 





























148 


BREGMAN 


Graph V is tlio sum of these tests. Here the two Ki’oups show 
marked tendency to separate, but there is considerable overlapping. 

Graph VI repre.scnts the tests weighed and cDinbincd in accordance 
with the regression equation. 
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The overlapping has been diminished—and the salesclerks form a 
fairly clear characteristic group, the clericals as distinctive a group. 

After these regressions and other calculations had been made for 
the 43 clerical workers, it became possible to test 20 more clerical 
workers. It seemed inadvisable to recalculate on the basis oi the 
enlarged group the weightings as originally found, but it did seem of 
interest to see wlut effect adding these 20 cases woidd have on the 
coefficient, when the tcsls were weighted in accordance with the values 
that had been obtained from the smaller group. 



.‘Ipplicaliiins. Ml ripplicants f<»r rmploymciu, duriiijj tliii 
lime in which ilic i-xiaTinu-nial work uIma’c (lescril)(jfl was 
being carried on, were iu’ing lesird with tltc CDmplclion Scale 
tvliicli has been previously ntcnii‘)iu*<l. atnl which served lo 
indicate nidiUal dcfeclivcs ami sulmormal individuals. Upon 
llic lindings <liscu'^scd al)ov4' iIh* of tests T K. T 12 and 

T 13 were addetl to the lest alri:a<ly in use and all applicants 
who were consIdcrcHl for clllicr selling or clerical woikers 
were tes(c<l with thi.s group. aii<l placcntnnt made n.s far as 
jjos.siblc ij] accordance with the rharaderi.stic range into winch 
the lest scores fell, whelher sales or clerical. 'I'he Completion 
Scale was still retained anti in every case given to the aj)pli- 
caiit before the grouj) of tests, ‘'rluis the fact that a low score, 
or one in ibe rangt; characleristic of salesclerks was due to 
general mental inferittrity, and not otlicr causes was guarded 
against. 

The tests iiave licen in use for some time, In about 50% 
of the cases intiTvie\v(‘rs have applicants tested before place¬ 
ment, Hie ollior 50% oi the ca.scs arc placc<l and (hen le.sted— 
the placement being .snbjecl lo revision when ihe le.st jinfling.s 
strongly contradict the ))hiceinenl. 

Aj)j)licanls arc. tcsli*<l generally hy a clerica! woikcr, who 
works under Ihi; direction of the wriler and has been specially 
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trained to give and score the tests. As many as 160 appli¬ 
cants have been tested in one day. Applicants are tested 
singly, or in groups up to 10. 

The tests are also used in cases of personnel adjustment, 
transfers, selection of candidates for training classes, etc. 

A careful follow up by rating and production record is being 
carried on in order to check, the test records with actual work. 
These are not yet in such a form that fijidings can I)e pre¬ 
sented statistically, but on the whole, from a rough .survey 
of the evidence at hand and from isolated cases which have 
come in for special attention the findings reported above tend 
to be borne out. 

i'luitiimry. In a large department store methods of olitain- 
iiig reliable criteria for work ability of salesclerks and clerical 
workers were carefully developed; Workers were grouped 
into three classifications, very good, poor and average, and 
tested with a series of mental tests; only those worker's being 
tested who were cojkswtentfy placed in one of these three classi¬ 
fications by all available criteria. 

The good and poor salesclerks when tested gave negative 
coefficients of correlation, some markedly high. Similar groups 
of clerical workers likewise tested gave positive correlations, 
not so high. 

When the two groups of workers, sales and clerical, were 
combined, the good workers of each type could be selected 
from the heterogeneous group by test marks, generally with 
accuracy as great or greater than from the homogeneous 
group. This was especially true if the jjoor workers of one 
group were omitted when selecting for the good of the other. 

New tests were devised which were similar in form to those 
that gave the highest correlations- These te.sts differed in 
content by being less academic, more industrial. These and 
several tests in their original form were given to a group of 
100 average salesclerks and 43 average clerical w'orkers, The 
relationship between the two groups which had obtained with 
the original tests and the original groups tested held with the 
new tests and the new groups. 

The regression equation was determined for the three tests 
\yhich, taken singly, gave the best correlations—T 8, a Direc¬ 
tion Test, T 12, a Judgment Test and T 13, a Comparison 
Test. The best weightings for these tests when combined 
were thus determined. 

Biserial r for this group of tests and the group of 143 
workers was ,74. Twenty additional cases, clerical worlcer-s, 
raised the coefficient to .83. 



A STUDY IN INDUSTRIAL PSYCHOLOGY 


151 


These tests are now i)cinK usc<l in connection with the em¬ 
ployment (jf sales and clerical workers. 

At a later dale it is hoped lo iivesciU data resulting from 
the follow uj) (if the work (if employees so tested. 

Ill presenting? this record of the work toward the develop¬ 
ment of tests for sjieclal ahiliiy, the writer is not unaware 
of llic fact that much of the procedure and liaiidiing of the 
data varies from orthodox lalioralory methods, Ideal labora¬ 
tory conditions, are however rarely, if ever, jiossiblc to an 
industrial psycholoLMst, who must make what shift he can. 
The exigencies of the occasion are therefore ofTered as an 
excu.se for the dejiarUtres from the orthodox, That in spite 
of necessai'ily improvised methods certain rclakionship.s were 
seen to hold consi.stenlly tnic, might in itself be ofTered as an 
"end justifying the means” excuse. 

Also the subject of the negative corrclaliojis whicli were 
found, their w)iy and wherefore, i.s a matter of some interest 
and iinportance u'hicfi /lie present paper does not toncli, 

The findings themselve.s are (irc.seiitcd, for comment and 
criticism, and witli the (lioiigiit (hat, in (he light of the present 
scarcity of work on tests for special aliilitics, the greater 
scarcity of literature on llu* same subject, and a certain feel¬ 
ing of discouragcincnt wliich has recently become associated 
with work in this ndd. tlie history of this work would possess 
some interest. 

NoTr,—It sluuiUl l>c noted in connection with the iiurtvidnnls 
tested in tins oxiierimcnt, that they iMissp.sscd one aUribulc in additloit 
to that of ahiliiy or disahiUly at a special job, (liai attrihiitc being' 
/ferm/ic/tcy as irorker.s. The workcr.s were rated In June, .sale.s recorti.s: 
were bcwuii from May, the Ic.sljntr la.stcd into January of the following 
year and ratings were iiintblainablc for workers who Imd not been 
employed lor sonic lenBih of time previous to June. Consequently 
only such individuals could have been inclu<lc(i amonR those tested 
as were fairly (icrmanent workers-. ^Stability is as imporlaiit a quality 
in a sati^facteny cniployce a.s ahtlily it.self. 

It is conceivable iliat any .snjierior individual, making in the tests 
a score beyond tiic vaiiKC of both clerical workers or salesclerks would 
do excellent work at cither job. It is however (.since promotion 
can of nccc.ssity come only to a limited number), highly inconceivable 
tliat such an iiiclividuaf would remain for more (han the briefest period 
at sucli work a.s tlcparlnienl store .salesclerks or clerical workers arc 
called upon to perforin, day after day, and such individuals could 
hardly be counted on to make up the bulk of the 5,000 workers who 
carry on the business of such an orBanizalion. 

The median inlellli'encc of the workers in (liis -(tore approximates, 
(from data not yet pirlili.sheil), the degree of irUdligencc wbicli wa.s 
found clinracleri.slic in the Army 'I'esis, and it is for such individuals 
that the standards bore set foriii bnlil inie. 




ESTIMATING INTELLIGENCE BY MEANS OF 
PRINTED PHOTOGRAPHS 


By L Dewey Anderson, Bureau of Personnel Research, Carnegie 
Institute of Technology 


Purpose 

The purpose of this investigation was (1) to determine the 
reliability of photographs for indicating the intelligence of 
strangers, and (2) to seek out differences in the ability oL 
various persons to judge intelligence by this means. The 
results of the study might be applicable to problems of selec¬ 
tion arising in an employment office. 

Method 

The photographs used were prints (from cuts) in a hand¬ 
book published by a large department store company, They 
represented the faces of 69 employees of that company- These 
persons consisted of superintendents, buyers, managers and 
assistants, 

In the fall of 1920 the same 69 persons were given tlie 
Bureau of PersonneL Research adaptation of the army intclU- 
gence test, and the scores in this test were used as the intelli¬ 
gence criterion, 

The photogj'aphs were all Ijoiind in the conipajiy animal, 
or handbook, but the printed matter on each page was con¬ 
cealed by a paper shield. The person judging the pliotogi’aphs. 
therefore, had to finger tlirmigh the book, picking out tlic 
individuals, and de-signating them by the niiniber which was 
given to each, to indicate their intelligence rank as described 
below. 

Twelve judges passed upon the photographs. These judges 
were selected from a nearly homogeneous group of graduate 
'students and instructors in psychology and there was very 
little chance of other influences entering into the judgiueiUs 
of intelligence given, 

The instructions were as follows: 

Instructions 

" These photographs will introduce you to the 69 iminager.s, 
buyei’.s and assislanl.s of the —-Company, You are a5ke<i 
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jp fj/ii/irtfc //ir iiiG’//t(M'nri’ iii jn'Cipk; liy a careful study 

of (heir , , , , 

"First, scan tlirounb iiu- linnk and an impression of the 
general cliarader f»l lids 'I'lfu I'iek out die fodoudiig; 

“ (1) I’he seven nio^i iiitelli^ciU iiersons. 

(2) The seven leasl inirlliKetil persons. 

(3) The f<nirleen p;-i>ons wlio are svipi'iini-. iml not as j^oud 
as (he best seven. 

(4) The ionrieen peisons wli" are inferior. Inn not as poor 
as/he u’orst seven. 

"The reason for ihr ^innpiim Ky sevens is found in iho fact 
[hat (here are ahoni -even individual,- in each decile. The 
highest 10 per ca-ni. il»e lusl dd pi-r laiU. tlu' InwcsL 10 per 
cent and die ne.vi h«ue>i 20 piT eem. are tines .sonf^ln. Thi.s 
would leave an undiifi-K iniaied miiMle uroup of 40 per cent, 
The entire luranKenwni is (luis intended simply to sift out 
the extremes." 

TAMf.l-: I 

Success ok V.\mor- Ji iu.ks in Km imatino uy 

I'll' nVH.R WllS 


Judge 


A 

B 

C 

D 

E 

F 

G 

H 

I 

J 

K 

L 


No. Ilf Alec- Xn. <if 
luiely Kichi tno iy Unoiii; 

JiulKineni-- Jiitii’iii'Mi’ 

111 I 

7 1 

'/ 1 

.1 l 

(i 

10 1 

8 0 

10 :t 

8 1 

7 1 

7 1 

10 ;i 

0(1 11 


N((. Ilf Jiuln- 

No. of Jucly- 

meinson tin; 

meulsou tlic 

(.’cin'e'et Side 

luconeui Side 

;!7 

Ih 


1‘1 

;*.a 

17 

;!:i 

11) 

IP 

1*1 

::)i 

III 

;ei 

I’O 

P‘j 

20 

::i) 

22 

::o 

•}'i 


20 

•t') 

20 

:':n 

221 


Ill this lalile “ ali.-oliuelv riejil ” iin ans iliai die man’s plmlo- 
graph was iissi.qned in the (’.Vio / i/n'iil' iiiin wliich the inlclli- 
gence lest placed liiin. '‘.Mi'cluii-Iy n roue; " means ihat (he 
very superior man wa^ marked very inferioi nr ilu- very in¬ 
ferior man was mai'lo-rl vitn' su]ierini'. I'larin^i ihe inferior 
man in the very snpeiinr proup or die sniii'iinr man in the 
very inferior [^rnup, eie.. imlieaied in die (i licnimnn, *' Judi;- 
incnts on the lairri-el -ide" are dm^ie where Mipei hinly In ihv 
average has hern rird'dv ili'-eviminaied aivl wiiei'e mleiinrity 
to the avei'aife has heen riidilly d^^el•iminau'(l, 
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From the above table it will be noted that there are 96 
absolutely right judgments and only 14 absolutely wrong judg¬ 
ments. Tills means that out of 110 judgments, 96 were abso¬ 
lutely right and 14 were absolutely wrong, or [daced in the 
directly opposite group. In the last two columns of the table 
there are 271 judgments on the correct side and 231 on the 
wrong side, These data show that the judgments of intelli¬ 
gence based on photographs are, in this experiment, fairly 
accurate where only the extreme degrees of intelligence as 
measured by other criteria are involved. If all judgments are 
considered, i.e., if the middle group .that is badly ‘judged’ 
is included, there is a very slight tendency to accurate place¬ 
ment. 

A product moment correlation was made by assigning values 
to votes as follows; A judgment as very intelligent was given 
a rating of 2, a judgment in the least intelligent group a 
rating of —2, a judgment of superior, a rating of 1 and a 
judgment of inferior, a rating of ■—1. The ratings given to 
each photograph were summed and a product moment correla¬ 
tion of --|-.27 with intelligence test scores was secured. The 
probable error is .07. This correlation shows that there is a 
positive relationship between photograph ratings and intelli¬ 
gence test scores, 

Another correlation was figured by the rank method between 
tbe judgments of 31 store managers on each other and the 
photograph ratings. The managers' judgmeutS were made on 
the basis of general value to the firm or general ability as a 
store manager. A correlation coefficient of -j-.22 was found. 
This shows that there is some reliability in the correlation 
coefficients. 

In all of these computations the "average ” group is omitted. 

Conclusions 
I, Geiicrol Reliability of Photographs 

It seems very doubtful whether for practical purposes intelli¬ 
gence can be gauged by a. study of a man’s photograph. The' 
correlation of ~\-.27 between assigned ratings and intelligence 
as measured by the Bureau of Personnel Research Intelligence 
Test shows, however, that there is some tendency to discrim¬ 
inate intelligence above mere chance selection. From a study 
of Table I it was found that 16 men were placed at least once 
in both the most superior and the most inferior group, 49 
people were placed in both the superior and inferior groups, 
18 people were placed in both the most intelligent and the 
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inferior groups unci 29 were placed in both the least intelligent 
and the superior groups. From these results, it appears that 
selecting employees by a study of photographs would be a very 
haphazard way of selection. When competent raters place men 
in both the highest aiifl lowest classes 16 limes out of a possible 
69 chances, there is lillie possihilily of upholding the practice 
of photograph rating- 

There seemed t(> l)e considerable agreement among the raters 
ill regard to some photographs. A point suggested hy this 
agreement is that people in judging a person by his photo- 
grapli usually jdek out a particular feature such as the lustre 
of the eye or the width of the brow from which to draw their 
conclusion, In this .study it was impossible to check tliis belief. 

IL Individual Differences 

There arc considerable individual differences shown in ability 
to make ratings on intelligence from pliotographs. One rater 
made only four absolutely right judgments, while another made 
twelve. Tlte average number of correct judgmejits is 8. From 
Table I, tlie iimuber of absolutely wrong judgments is 14, thus 
showing, when, compared to a total of 96 absolutely right 
judgments, that the raters were using some criteria of judging 
that served to pick out right men. The difference between 
poor and good raters is not as well marked in judgments that 
merely'rightly jdace (he pholographs as in “absolute” judg¬ 
ments. The best record was made by ‘'A/' having 27 right 
judgments and 15 incorrect ones. The poorest records were 
made by two people, I and J, each having 20 correct and 22 
incorrect judgments. 

By dividing the nutnlier of correct judgments by the total 
number of judgments a percentage of accuracy was gained for 
each rater, 'I'hc.se [lercenlage.s follow; 


A, 

B, 
C 
D 

E, 

F, 


6 - 1 % 

55 % 

59% 

51% 

47% 

62% 


G.52% 

H.52% 

1.47% 

J.47% 

K.52% 

L.52% 















TWO CASES SHOWING MARKED CHANGE IN I. Q} 


By W. T. Root, UmvcTsity oi Pittsbvivgh 


Every psychological examiner lias, from time to time, certain 
cases in which testing’ and retesting even within a brief period 
of a few months yield decidedly different mental ages and 
consccjuently different I. Q.'s. Eiirtliermore many of these 
cases cannot he traced to clerical errors, to moot questions 
in scoring, or to the personal equation, which may be a factor 
of discrepancy when different persons have administered the 
test at different times. 

The cases here presented are typical of a not infrequent 
performance where school conditions permit individual atten¬ 
tion and free grading. Both children came up for examina¬ 
tion the second time due to the curiosity of certain teachers 
who had noted a marked improvement in the character of the 
work ill each case, and also improvement in alertness and 
grasp. Perhaps the best way to get at these cases will be to 
give in detail the tests not passed the first time l3ut passed 
die second time, 

Case A 

Age first examination, 9-0; mental age, 8-4; retardation. 
8 months; I. Q., 92. Second exaiuinatiou, age 9-4; mental 
age, 9-9; acceleration, 5 months; I. Q., 104, Both times year 
VII was the base year. The first time the following tests 
were failed; year VIII, 1 (very poor), 2 (nearly performed), 
5 {b is plus, a, c, and d failed) ; year IX, 1 (day of week only, 
given), 2 (nearly correct, 12 and 15 gram weights inter¬ 
changed), 3 (very slow and inaccurate, not even good ap¬ 
proximations, e, g., 25-4 equals 7), 4 and 6 (nearly passed). 
As IX 5 was the only one of this year passed, the testing would 
have closed with this year, but for the vocabulary score which 
carried the examination into the X year. In diis year tests 4, 5, 
and A1 2 were failed. Tests 6 and A1.3 were not given. All 
of year XII failed. 

The second time the examination -was given the following 
tests were passed that were failed the first time: Year VIII, 
1 (just scored), 2 (28", 0 errors) :year IX, 1, 2 (3 still failed 
25-4), 6 (passed easily). The score for X remains unchanged 

1 From School of Childhood, University of Pitt-sburgh. .Stanford 
Revision of Binet Tests used. 
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with the exception of A1 2 which is passed (barely) this time, 
but does not count in the score. In the XII year the interpre¬ 
tation of pictures is now siiflicienHy good to warrant scoring 
here. 

In this case two factors offer plausible explanation for the 
advance in the second examination; (1) marked iniproveinent 
in sight cand the clearness of discrimiiiattion in reading; (2) 
rapicl academic advance (noted by teachers)’and most plausi¬ 
bly attributed to free and semi-individiiai jnethod of teaching 
whiclt permits a direct attack on the peculiar weaUnesse.s of 
a pupil, in this case the three R’s especially. A general clear¬ 
ing up in mechanics of reading, and a slight increase in verbal 
fluency and number combination would account largely for tlie 
differences in the two tests. 

Case B 

Age first exajnination, 6-8; mental age, 7-6; acceleration 10 
months; I. Q., 112. Second examination, age 6-11; mental 
age, 9-8; acceleration, 33 months; I. Q., 140. In the first 
examination year V is the basic year; year VI, test 1 is failed; 
year VII, 6; year VIII, 1 and 6 (vocabulary 16); year IX, all 
but number 4 are failed, thus closing the examination. 

In the second examination tests VI-1 VII-6, and VIII-1 and 
•6 are pas.sed making VIII the basic year. The vocabulary is 
22 words. There is a good performance of the Ball and Field 
against a complete failure the first time. In year IX tests 
5 and 6 arc passed with ease while 4 (repeat 4 digits back¬ 
wards) is again barely passed. In year X, tests 2, 3, 5, and 6 
are passed; in year XII, 3 and 7. Tests 2 and 6 (year X) 
are performed with ease and would probably have been passed 
the first examination. 

In this case the increase in I. Q. can be accounted for 
plausibly by the factors suggested as causal for case A. Be¬ 
sides these factors which first suggest themselves, several other 
causes for fluctuation may be outlined tentatively; 

1. A school permitting individual • advance can make an 
attack on individual academic weakness, thus attention may 
he focused upon sentence structure, phonograins and addition 
combinations if they have proved to be weak. Such drill could 
conceivably have unintentionai but nevertheless indirect effect 
upon year IX, 3, 5 and 6 (Making change, Using three words 
in a sentence, and Rhymes, respectively). These three tests 
correctly performed mean an addition of six years mental age. 
In the School of Childhood reading is delayed until the second 
grade, which might readily account for the failure in Rhymes 
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in the first grade, and passing of the test with ease after drill 
in ay, ill, and ing endings. 

2. Every examiner has noticed that a child may just fail 
in several allied tests. Chance conditions may make these 
tests just barely plus on reexamination. Every teacher has 
also noted that after a rather discouraging plateau, a child may 
suddenly get a "hunch” in reading or number work. At 
times understanding seems to act on the all or ■none principle. 
The emotional attributes of failure and success could also 
play a part in test performance. (Case A and B, it will be 
recalled, came up for reexamination because their teachers 
had noted a marked improvement in their grasp of subject 
matter,) 

3. Superior children are often those who have been brought 
under adult influence and culture to a marked degree. They 
possess a peculiar "adultish” ability to answer in a mature 
way verbal and moral questions, which gives a wide scatter 
range in testing, making it unsafe to discontinue the test per 
instructions. For example, all of year IX may be failed while 
test 2 and 5 year X and test 5 and 7 year XII may be passed. 
This is precisely what subjects did. 

4. Improved physical condition may make an appreciable 
change in a short time. 

Such cases as here described seem to indicate the need of 
more careful qualitative examination of test responses in 
terms of individual differences. Also there should be frequent 
reexamination where the nature of the school freely admits of 
more than average advance. And finally there should be fre¬ 
quent reexamination of children who have made marked 
physical improvement from any cause. 



A PRELIMINARY STUDY OF THE CORRELATIONS 

between estimates of volitional traits 

and TtlE RESULTS FROM THE DOWNEY "WILL- 
PROFILE " _ 

By G. M. Rucir, Fellow in Education, Stanford University 


The results siimiiiarized iii the tables which follow were 
gathered in the attempt to compare the estimates of associates 
with the actual test scores earned in the Downey " Individual 
Will-Temperament Test” for the twelve traits comprising the 
scale. 

Estimates were secured from two groups of associates, viz., 
university instructors and students in the same classes, for 
more than twenty advanced or graduate students. Except in 
two cases those rated had been known to the judges for at 
least six months and in most cases the judge and the student 
rated were fairly intimately acquainted socially as well as 
in academic associations. The ninnbers of judges varied froin 
two to five for the faculty group and from four to eleven 
for the studejit group. No cases where the numbers of esti¬ 
mates secured were less than two or four, respectively, are 
included below; thus reducing the numbers concerned to 
fifteen except where a larger number is definitely indicated. 
The instructions given to the judges as to the nature of each 
volitional trait to be rated were taken verbatim for ten of 
the twelve from Dr. Downey’s instructions in her paper. 
" Some Volitional Patterns Revealed by the Will-Profile " in 
the Journal of Eri'crmental Psychology, Vol, 3, 1920, pages 
281-301, The remaining two traits whicii have been added to 
a later revision of the scale, viz., "Finality of Judgment” 
and "Volitional Perseveration” were described by the writer 
in the instructions, It was suggested that the judges rate the 
entire group upon trait one before proceeding to the next trait 
in the hope that greater comparative discrimination would be 
exercised by those making the estimates. 

The correlations were made by the Order-of-Rank method 
of Spearman corrected to approximate the Pearson Product- 
Moment foninila. 

The correlation between the total scores (sum of scores in 
twelve traits) and scores In Army Alpha for fifteen .subjects 
was found to he —0.09. For the pooled estimates of faculty 
judges and .^Ipha. r was —0.12. 
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TABLE r 

Showing the Correlations Between the Scores for the Twelve 
Traits and the Pooled Estimates of the Jctx.f-s for the Same 
Traits, Subject by Subject 

Sul-iject Pooled Estimates of Pooled Estimates of Pooled Estimates of 
Faculty Judgcswith Studenlswilh Faculty with Pooled 
Test Scores Test Scores Estimates of 

Students 


P . ,26 (31 .48 (11) .88 

Wy ,,,, —.06 (3) .5-1 aO) .16 

Fe. .00 (5) .31 (10) —.65 

Dar. —.15 (3) —.13 ( 8) ,87 

C. ,02 (4) —.13 tlO) .59 

Wh. .13 (3) .23 aO) ,53 

R. —,18 (2) —.64 ( 9) ,84 

Day. —.12 (2) .57 (9) —.04 

B. .29 (4) .10 aO) .76 

We. —.13 (3) —.38 flO) .76 

Fa. —.11 (4) .14 ( 7) ,83 

L. ,17 (4) —.40 (5) 76 

H. —.13 (4) —.05 ( 4) .43 

T.,. .03 (2) .33 (10) —.30 

Deb. ,10 (3) .22 ( 7) .70 

Average.. ,01 .08 ,47 


( j Number of judges. 


TABLE 11 

Correlations of the Estimates of Faculty and Students and the 
Test Scores and Between the Estimates of the Two Sets of 
Judges, Trait by Trait 


Test Trait Testwith Test with Fac.with 

Number Fac.EsL Slud.Est. Stud.Est, 


1. " Speed of Movement ”. 

2. “.Freedom from Load ”. 

3. ''Flexibility “... 

4. “ Speed of Decision ” . 

5. “ Motor Impulsion ". 

6. " Assurance ’’... 

7. “ Resistance’'. 

8. " Finality of Judgment ”.... 

9. " Motor Inhibition ”. 

10. “ Care for Detail ”. 

11. “ Coordination of lmpuls(» " 

12. “ Volitional Perseveration , 

Average. 


.02 

.43 

.72 

—.09 

.27 

.28 

.45 

.17 

.22 (S) 

—.02 

.53 

.67 

.51 

.50 

,73 (S) 

.23 

.37 

,86 (S) 

.35 

.28 

.67 (S) 

— .11 

.07 

,45 

— .33 

—.23 

.66 

.15 

— ,07 

.77 fS) 

—.09 

,05 

.64 (S) 

—.26 

.05 

.72 

.07 

.20 

.62 


(S) Scoring in part subjective. All others purely objective. 
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TABLE III 

AVERAGE INTER-CORREI-ATIONS OF THETHREETyPES OH GROUPS OF TESTS 
Within the Downey Scale. Viz.: Traits 1-4 or “Hair-Trigger “ 
Pattern; Traits 5-8 or ‘‘ Wilful Aggressive “ Pattern; and 
Traits 9-12 or " Slow, Accurate, Tenacious ” Pattern 

Average Inter-Correlation 


Pattern of the Four Tests Mak¬ 

ing up the Pattern 

I. " Hair-trigger “ (1-4). —,005 

H. “ Wilful Aggressive “ (5-8).. .04 

III, “ Slow, Accurate, Tenacious “ (f)-12). ,06 


TABLE IV 

The Reliabilities of Estimates and Tests as Obtained by the Method 
OF Correlating the Scores or Estimates for the Odd-Numbered 
Tests with Those for the Even-Numdered Tests, the Scores 
Being the Trait-Scores 



r 

N 

Downey Scale. 

. —0.15 

15 


—0.21 

22 

Faculty Estimates... 

. 0.86 

15 

Students’ Estimates. 

. 0.58 

15 


From table I it seems evident that the estimates of the 
judges show no relation to the actual test scores but that 
they do show a fair amount of agreement between the two 
.set.s of judges (average, .47). The students seem at first 
sight to be somewhat the better judges, but the apparent dif¬ 
ference may be due to the fact that the number of students 
furnishing ratings was considerably greater than the number 
of instructors. 

Table II .shows a similar result. Considerable agreement 
between judges but little or none between estimates and tests 
is shown. It might be stated that students and instructors have 
a common concept of the significance of tlie traits (or rather 
of certain of the traits) but that these concepts do not cor¬ 
respond with the psychological processes concerned in the 
tests of the Downey scale. It was feared by the writer that 
his comparative inexperience in giving the tests, and particu¬ 
larly in scoring, might he re.sponsil)ie for the lack of higher 
agreement between estimates and tests. However, on the 
whole, tliose tesLs where the scoring is purely objective give 
poorer results than those where the personal equation does 
enter to some extent. 

The treatment of data as given in table HI calls for definite 
reference to an i.ssuc involved which may he entirely unfair 
to the Downey tests. The n.ssumplion has Ixcn made in 
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resorting to the method of average inter^correlations within 
the three groups of four tests each which have been desig¬ 
nated as ‘'patterns" that there should be a fairly high com¬ 
munity of psychological processes within such patterns and 
that there would be a corresponding absence of close relation 
between tests of difTereiit patterns. This may not be a true 
conclusion, although Dr. Downey has stated that the tests 
are so grouped, tentatively, in order to bring together tests 
of the same general type. 

Similarly in Table IV the same assumption has been made, 
The correlation of the odd-against the cven-numbp.red tests 
really breaks the entire scale into half-scales in which each 
pattern is represented by two tests rather than four tests, 
This again may be unfair. However, the nature of two or 
more of the tests of separate traits makes it impossible to 
obtain measures of reliability by repeating the tests on another 
day, The increase in the number of subjects from fifteen to 
twenty-two lowers the coefficient somewhat rather than rais¬ 
ing it. 

The extremely small number of subjects used makes it 
imperative that all criticism of the Downey Will-Profiles be 
foregone even if the writer were so disposed. These results 
may possibly have some value and interest to others and it is 
hoped that they will serve to aid the efforts in a pioneer and 
inestimably valuable field of research. It is hoped to extend 
these preliminary findings as soon as possible to a point where 
greater reliability can be assured for the conclusions which 
may be drawn, 

April 1, 1921. 



preliminary report on a gifted juvenile 
AUTHOR* 


By Lewis M. Terman and Jksie C. Fenton 


Data, on gifted children have been accumulating at Stanford 
University since 1911. In 1915 one of us published a brief 
summary of facts relating to 54 children testing above 120 
IQ, and certain additional material relating to 31 who had 
an IQ of 125 or above. (Tcrman; " The Mental Hygiene 
of Exceptional Children,” Pedagogical Seminary, 1915, 22, 
529-537.) In 1916, widi the assistance of Margaret Hop- 
wood Hubbard, more systematic work was undertaken in the 
locating, testing, rating of gifted children. In The Intelligence 
of School Children (Houghton Mifflin Co., 1920) fairly ex¬ 
tensive data were reported on 59 cases, most of whom tested 
above 140 IQ. From 1917 to 1919 little was accomplished, 
owing to the interruption caused by the war, but during the 
last two years the work has occupied somewhat more than 
half the time of a research assistant. Onr files now contain 
test records and other data on nearly 200 gifted children, 
most of them above 140 IQ. These are being followed up 
from year to year and as many as possible are given re-tests. 
At present the entire plan of work is being revised prepara¬ 
tory to gathering extensive psycholt^ical, educational, social 
and biological data on 500 to 1,000 of the most gifted chil¬ 
dren in California, An important feature of the plan is to 
follow up as many of these cases as possible for a period of 
at least ten or twenty years. One of the most interesting 
of the children thus far studied is the gifted juvenile author 
described in the following pages. 

Betty Ford was born in San Francisco, January 21, 1912. 
Her four grandparents were of Swedish, German-French, 
English, and Scotch descent, respectively. There is nothing 
especially reniarkaljle in her family tree. The mother is a 
woman of more than average intelligence and of considerable 
musical ability, The father is a physician and the author of 
the " Ford Stitch,” favorably mentioned in standard texts on 
surgery. Betty is an only child. 

*Rea(l before the American Psychological Associalion, December. 
1920. ' 
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In Betty's baby-book, kept by her niotlier, we find the fol¬ 
lowing entries: 

Weight at birth, 11 pounds, 15 ounces. 

Weight at 20 months, 31 pounds. 

At 7 months began to walk about in her " walker.” 

At 19 months said everything clearly and knew the alphabet, 

At 20 months put together block puzzle pictures. 

At 22 months enumerated birds up to 12 in a picture, 

In view of her intellectual precocity it is interesting to note 
that Betty's earliest memories, if we can accept her own testi¬ 
mony, date back-to the time when she was still fed by bottle, 
at the age of about 12 months. 

Betty’s parents say that they first learned of her ability 
to read when they discovered her, at the age of 4^4 years, 
reading Heidi, a book of about fourth grade difficulty. At 
five she read such books as Silas Marner and Charles Lamb's 
stories. By her eighth birthday she had read approximately 
700 books, many of them twice. For the last two years she 
has read on an average at least eiglit hovrrs a day. She reads 
rapidly and with complete absorption. Instead of finishing 
one book before proceeding to another, she prefers to keep 
three or four going together. At the age of eight her favorite 
authors included Shakespeare, Burns, Longfellosv, Words¬ 
worth, Scott, Poe, Victor Hugo, Thackeray, Dickens, Cooper. 
Mark Twain, Barrie, Conan Doyle, Kipling, R. L. Stevenson 
and George Eliot. 

At the age of 30 months Betty began making uj) little stories 
about rabbits, frogs, fishes and squirrels. At 33 months she 
composed little jingles in rhyme. Stories and jingles con¬ 
tinued to appear from time to time, but before the sixth birth¬ 
day only a few were recorded. When she was six years old 
she was given a typewriter, and with its assistance and stimulus 
she was soon well launched on her literary career. By the 
age of eight she had written more than 100 poems and more 
than 75 stories, together enough to fill a volume of 200 or 
250 pages. 

We first saw Betty in November, 1919, when she was 7 
years, 10j4 months old. Since that time we have spent ap¬ 
proximately thirty hours with her, giving her tests, showing 
her about the University or visiting with her in her home. 
Six weeks before her eightli birthday she tested 14-10 by the 
Stanford Revision; IQ 188. Her vocabulary at that time was 
approximately 13,000 words, which is not far from the median 
for Stanford University freshmen. Her score on the Army 
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Beta test was 71, which is about the norm for 14 years. Thus 
her IQ measured by a non-verbal scale is 175. By the Na¬ 
tional Intelligence Tests she graded above 15 years (score, 
Form A 152,8, Form B 123), and by the Terman Group Test 
considerably higher (score, 151, Median lor Grade 12). On 
the Trabue Comitlction tests, B and C, her score (17.5) equaled 
the median for third or fourth year high school pupils, She 
took the memory span test for digits (oral presentation) with 
a class o£ 21 graduate students, beating ten and tying four. 
Her extreme memory span is 9 digits, direct order, and 7 digits, 
reversed order. On the Kelley construction test, which was 
given her by Dr. Kelley, her performance resembled that of a 
normal child of nine or ten years. On the various types of 
tests found in the Stanford Revision, the National, the Terman 
Group and Beta, her ])erformance runs fairly even, though not 
perfectly so. She is at her best in vocabulary, information, 
language completion, and memory, and at her worst in tests 
involving arithmetical processes. 

Betty has never attended school, but for nearly two years 
she has had about two hours a week of private instruction in 
dancijig, French and German. During the last year her mother 
has given her, intermittently, a small amount of instruction 
in arithmetic, usually not more than an hour a week. On 
the Woody te.sl.s for addition, subtraction, multiplication and 
division her scores correspond to the medians for grade 5, 
On the Kansas Silent Reading test she scores at median for 
the 11th grade, on the Thorndike handwriting scale at median 
for 8tli grade, on the Starch Grammatical Scale (A) at median 
for 8th grade, on the Starch Punctuation Scale (A) at median 
for 6th grade, on the Teachers College Spelling Scale (List 
16) at median for 8th grade, on the Grier tests of informa¬ 
tion in zoology and physiology considerably better than the 
standards given by Grier for second term high school pupils, 
and on the Abbott-Trabue test of poetic appreciation at the 
median for second year college students. 

As a test of Betty's poetic ability, five of her poems, selected 
Ijy a dozen judges as her best, were clioseii for comparison 
with twelve other poems, including the following: three from 
a published volume of poems written by Stanford students, 
three by Longfellow (one of them written when the author 
was 9 years old and one when he was 13), one by Tennyson, 
one by Blake, one by Blandcn, one by Wordsworth, one hy 
Flenick, and a juvenile poem by Shelley. These twelve poems 
and five of Betty's with mimes of aiiLljov.s omilLcd, were 
ananged for order of merit by 46 Stanford students (chiefly 



166 


TERMAN AND FENTON 


seniors) enrolled in advance eJasses in versificacioii, Browning, 
and composition. In die combined rank order, based on die 
ratings of the 46 judges, Betty’s five poems held rank's 8, 9, 
10, 11 and 14. For each of her poems the mean deviation of 
the 46 rankings from the average rank was between 2.5 and 4.1. 

The rank orders based on the combined rating.? were as 
follows; 

1. Monterey: Stanford poem by Glcmi Arthur Hughes 

2. Song’. Stanford poem by Dorothy Gunnell Jenkins 

3. Shaiieen: Stanford poem by James Leo Duff 

4. Snowflakes: Longfellow 

5. The Eagle: Tennyson 

6. The Battle of Lovell Pond: Longfellow (Written at 
age 13) 

7. The Song the Grass Sings: Blaiiden 

8. My Prayer: Betty Ford 

9. After the Rain: fietty Ford 

10. The Clouds; Betty Ford 

11. Joy: Betty Ford 

12. March: Wordsworth 

13. The Wildflowcr’s Song: Blake 

14. The Rainbow: Betty Ford 
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15. To Violets; Merrick 

16. Mr. Fiiiiiey’.s Turnip; Longfellow (Written at age 9) 

17. Tlie Cat in Distress: Shelley (Written at age 8) 

The selection of poems for rating demands a word of ex¬ 
planation, In general, jmeins were selected which were not 
too unlike Betty’s in content, which wei-c presumably not well 
known by the judges, and which were relatively brief. Three 
were selected l)ecause they were juveniles. The five of Betty’s 
were selected by about a dozen graduate students as being 
among her best. Three of the. five were judged by Betty as 
among lier be.st. 

It will be noted that the first three jdaces are won by Stan¬ 
ford poems. This may be entirely due to the fact that they 
were probably known to a good many of the judges, though 
they are not without considerable merit. Two of the juvenile 
poems by well known authors arc raterd at the bottom of the 
list, lint one oi the juveniles by Longfellow is given fourth 
place, We reprocluce some example.s of the seventeen poems, 
those of Betty in their original spelling and punctuation. 

SONG 

(Stanford poem. Rank 2) 

There i.s life in the green of the hills, 

There is joy in the mist in the hollow, 

Where the son|^ of the meadow lark tlirills,— 

Up. iny heart, follow. 

There is joy in tlu* song of the .sea, 

There is life in llte dip of the swallow, 

Aiul the voice of the world calls to me,— 

Up, iny heart, fallciw. 

THE EAGLE 
(Tcnny.son, Rank 5) 

He clasps the ern^ with hooked hands; 

Close to the sun in lonely lands, 

Ringed with the azure world, he stands. 

The wrinkled sea beiicalh him crawl.s; 

He \vatchc.s from his mountain walks, 

And like a thunderbolt he falls. 

MY PRAYER 

(Betty Ford- Rank 8. Written at ape 7 years. 6 months) 

Oh, Master of fire, Oh Lord of Air, 

Oh God of waler.s. Hear niy prayer. 

OI>, I..onl of Krnuiid and of slirriiie trees 
O (inti of Man and of pleasant breeze 
Dear I'alher, Lei me happy he 
As happy as a Krowiiijj JT-cc. 
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AFTER THE UAIN 

(Detly Ford. Rank 9. Written at age R years, 10 inoiilhs) 

Birds carol glad and free, 

AH abonl joy you see, 

After ihc rain I 

Facli little throat swells glad, 

None can be ever sad, 

After the rain I 

Moss is a velvet green, 

Grasses of silken sheen, 

After the rain! 

Blue is the sky above. 

Everything smiles witli love, 

After the rain i 

Birds serenade the siin, 

Each little songster one, 

After the rain I 

Flowers smile back at him. 

No one can e'er be grim. 

After the rain I 

And So let Nature prove. 

In all is God’s great love, 

After the rain I 


THE CLOUDS 

(Betty Ford, Rank 10. Written at age 7 years, 3 months) 
The Clouds are soft white feather beds 
On which the fairys lie 
the fairys all look down on us 
as they come floating by 

but when the clouds grow angry 
they throw the Fairys down 
The fairys are so happy 
to visit at our town. 


Ques. 

Wliat are the fairys? 
Ans, 

Raindrops I 
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THE RAINBOW 

(Betty Ford. Ratilc 14. Written at age ? years, 3 months) 
The rainbow of Diana 
I.S aliinciiig in the sky 
Tlic siinbow of Apollo 
lia.s not just yet come by. 

Oh shine again 
thou lovely rainbow 
the (lark’iiing 
Twilights coming now 
thy brother's waiting 
O’er the sea 
He hath not yet conic 
home to thee. 


A CAT IN DISTRESS 
(Shelley. Rank 17. Written at age S) 

A cat in distress, 

Nothing more nor Icsa: 

Good folks, 1 must faithfully tell ye, 

As I am a sinner, 

It waits lor some dinner 
To stuff out its own little belly, 

You would not easily guess 
All the modes of distress 
Which torture the tenants of earth; 
And the various evils, 

Which like so many devils 
Attend the poor souls from Uicir birth. 


Some a living rcQuirc, 

And others desire 
An old fellow out of the way; 
And which is the best 
I leave to be guessed, 

For I cannot pretend to say. . 


One wants society. 
Another, variety. 
Othcr.s a tranquil life: 
Some want food. 
Others, as good, 
Only want a wife. 


But thi.s poor little cat 
Only wanted a rat. 

To stuff out its own little maw; 
And it were as good, 

Sovte people had such food, 
To make them bold their jaw I 
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Betty can soincthnes be persuaded to improvise a story or 
poem on a subject selected by another person. In such cases 
she dictates it, often more rapidly than one can take it down 
in longhand. One improvised poein of 16 lines she dictated 
to one of us in 2 mimrtes and 50 seconds. Twenty-one uni¬ 
versity students in an advanced class- in versification were 
allowed fifteen minutes in which to write a poem on the same 
subject. This test was given by the regular instructor as a 
class exerci-se. The poems were then typed and given to 35 
judges to be ranked in order of merit. In the combined 
ranking Betty’s poem held sixth place. Besides Betty’s, we 
reproduce the best and the poorest written by the university 
students, 

A TALE OF OTHER BLACKBIRDS THAN THE ONES IN THE 
KING'S PIE 
(Betty. Written at age 8) 

Four aiul twenty blackbirds 
Seated on a roof 
One did peck liis neighbor 
His neighbor gnintcd, “ OOf ", 

The ireighbor also, he got mad 
And pecked another bird. 

His neighbor also wasn’t glad 
And said a naughty word. 

This neighbor pecked another yet, 

The neighbor vowed he'd not forget; 
took vengeance on another fowl 
And rni.sed a long and doleful bow). 

Then that one turned without a word 
Aud pecked the very lastest bird,— 

So all the birds got in a quarrel 
Because of one ungodly fowl. 

Moral: If you do good, the good will be mirrored in tho.se around 
you. Also, if you be bad, the bad will be imitated by tlio.se around you. 

BLACKBIRDS 

(Rated poorest among the verses by university students) 

I sat on a window sill, 

The sun was shining bright; 

A row of blackbirds chattering, fill 
My mind with thots all right. 

But to Cell what I have in mind, 

Is Jiarcler by far, than to guess 
What the twitter of Hiose birds mean, 

As they spatter their -words about. 
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I fimc nil (heir poiiUed faces, 

And see by twirls and grimaces, 

Tlic crealurcs are pokiiif; at us, 

We wlio ibink we arc smart, 

At our expense and display, 

Fim of fbe grandest sort. 

One calls us worms, creatures that live in the clay, 

Another like grass dried up like hay, 

III.ACKBIRDS 

(Rated best among the verses by university students) 

Out there on the roof in the suiishiuc 
Twelve blackbirds arc stopping to rest. 

Their merry chirping and chatter 
rcrcImiKc, speak of spring and a nest. 

We sit at our desks near the window, 

And painfully, patiently try 
'I'o keep our eyes fixed on a lc.ssoii— 

Our minds on some old “Poly Sci." 

Oh, why cannot we, like tlie blackbirds, 

Sit out ill the bright moniing sun 
And muse on the coining of suimncr 
Wlicn alt of our lessons arc done? 

Out we cannot fly like the blackbirds 
Far into the dcqi, azure sky— 

Instead,—we may soar after knowledge 
AikI mount after learning so Irigh. 

The majorily of Belly’s poems htivc been composed in less 
than ten mimilcs. The sight of a rainbow or simsot, or robin, 
peichancc some ex])erience while at j)lay, or a suggestion from 
her reading, brings a flash of inspiration which sends her post 
haste to her typewriter. Recently, however, she has come to 
prefer dictation, because it leaves her freer to think, Hardly 
a word is changed (fiiring dictation and few afterward. Few 
false starts are made. At times she dictates more rapidly than 
anyone can write in longhand. While dictating her voice is 
low and lier words run into each olher so tliat tlicy are bard 
to catch. Meanwliile she walks', skips or dances about over 
the room, Her storic.s arc composed' much less rapidly than 
her poem.s, perhaps at an average rate of 300 or 400 words 
in a half hour. 

Betty’s prose compositions have not been rated, but on the 
whole they seem to he about as remarkable as her poems. 
Both stories and imcms .show a prolific imagination, a lively 
sense of humor, and keen [lowers of observation, Her diction 
is usually good, hut her sentence struclnrc often shows care- 
les,sne5.s and in poetry her meter sometimes limjis. We repro- 
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cluce a brief prose poem, a few lines of description from a 
story entitled "Tlie Honeymoon," a fairy story, and one from 
a series of nature stories entitled “ Stories the Alphabet Told ” 
(one for each letter of the alpliabet, written as a Christmas 
present to us). 

FAIRY DEFANITION. 

(Written at age 7 years, 11 ntoiUhs) 

Fairies arc the fancies of an imaginative brain, 

Which wearying of earthly realities aspires to 
create beings Hvcing only iii thought 
endowing the spirits thus created 
with all genius for giving 
HAPPINESS, 

P, S. I wonder why Brown-iip.s scoff at faries 
And heiteve that angels have wings. 

I don't think one is any harder to 
Believe than the other, 

Do you? 

PARAGRAPH FROM "THE HONEYMOON." 

(Written at age 7 years, lO months) 

"They stopiicd a moment to watch the sunshine glistening on the 
stream and to watch the suckers, trout and mbmows darting through 
the water. Once they caught sight of an eel. The fore-st was so 
interesting that day, At last after gazing a long time at the silvery 
fish they again entered into the wilderness. A little bvmny scurried 
across tlic path, a robin clurrupcd, a little squirrel came so close they 
were almost afraid of him, a cow mooed afar off, n pair of grouse’ 
scurried across the road even as the rabbit had done. A keen looking 
fox slunk along to the east. Once they heard a bear growl. Once a 
gentle eyed fawn rushed close past them. A pair of quail with fright¬ 
ened calls rose from some brush and flew over their heads to the other 
side. Once they came across the nest of some baby goldfinches." 

WHY THE DAISY HAS A GOLDEN HEART AND ROSY 

PETALS. 

(Writteir at 7 years, 2 months) 

ONCE the Daisy had no heart. Not even a sign of one, One day 
as she was loudly bewailing her fate like this—Ah me,'Would that 
I had even a tiny stone to take the place of a heart. Would that— 
At that moment the Sun came by. 

What are you alasing about little one? he said with a jolly laugh. 
Alas the daisy replied, I am weeping because I have no heart. Ho, 
Ho. laughed the Sun. "Is that all”? THAT is easily remedied, 
You know the sun is all made of gold, so he pulled out some of his 
hair and fasliioned It into the loveliest little golden heart you ever 
saw and laid it in the breast of the daisy. There little one, said the 
jolly sun. There take that and whenever you’r glad that you have a 
heart think of your old friend, the Sun, and he sailed away. (But 
the dear little daisy was modest and so timid and shy that what do 
you suppose she tlid,—She folded her petals tight around her golden 
heart. But iu the morning she grevr a little bolder and opened her 
pretty petals and all the flowers said, how wonderful tlic dai.sy has a 
golden heart. of j 
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PART II WHY THE DAISY HAS ROSY PETALS, 

Lillie Daisy stood in all hci^ beauty and ihe sun came by, there 
rt-as a little butterfly on a sunbeam—^snow-white with spots of g^old 
like the daisy Uersell—'So she called oul^— 

" Little butterfly dearest come down and talk with me, But the 
butterfly did not hear. She called a second time—Then the butterfly 
heard and fouldinR his wings dropped right down on the daisy's 
petals. Oh you beautiful thing he said, you beautiful thing. 

And tile Daisy bluslicd for joy—and ever since then the daisy has 
her rosy tinge. 

Moral, the things we hope [or may come to pass. 

STORK 

(Written at age fi years, 10 months) 

S stands for Stork who brings babies 'tis said, 

But before any see him, he’s back safe in bed. 

Sallie Stork and Sammy Stork were heart-broken. They had been 
married some weeks ago, they had built a nest, but Sallie had laid 
no eggs as yet, "Oh dear," they bewailed in concert, "What will 
become-of us if wc have no children? Oh dear, oh dear, we must 
have some children, we must, But at last one day, Oh joy, could it 
possibly be? There in the nest lay a big, white egg. What should 
she do 1 Oh they were in paroxysms of delight. 

They waited a long while and happy day, who came out of the egg 
but little Susan, Oh happiness! “Mamma,” she inciuired, in a sweet 
stork lisp, "Where am I? What's happened to me? The last thing 
I remember is good St. Nicholas taking me to one of the angels who 
put me in a tight white crib. What happened then, mamma, wont 
you tell me? " 

"Well," her mother answered, "I don't exactly know, but it ap¬ 
pears to me that wlien the angels put you into the egg, that's what it 
seems to me the crib was,—they brought you down and put you in our 
nest," 

"Well, that's nice,” said Susan, I'm sure I couldn’t have found a 
better mother in heaven. You know there aren't generally any storks 
up there." 

"Aren’t there?" her mother answered, "Well I’m glad of that for 
perhaps if there had been many, you wouldn’t have come down to us, 
you darlitig," "Indeed," chipped in Father Sammy, "I don’t believe 
they could have brought us a finer young Stork. 

So the days passed happily along and Susan grew fall and big and 
soon learned to fly. 

At length one day she suggested to Sammy and Sally, " Why cant 
we take a trip up to Heaven now. I’m sure my wings are strong 
enough, why not?" 

"Very we!],” Father Sammy answered, and Mother Sally agreed, 
"If you want to we will do it. When shall we start?" He enquired 
of her. 

"Why not start to-day?" suggested their neighbor, Susie, brightly, 
who had come in for a little chat. 

"Why not?" answered Susan, who was no longer little, "So here 
we go,” and they soared high up in the sky, Susie included, 

Finally they got there. All at once Susan gave a cry of joy— 
" St, Nicholas,” she cried, and flew rapidly lo-ward him. He wa.s a 
jolly roly-poly fat man. "Why if this isn’t Susan!" he cried gladly. 
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"My but you’ve been away a lonp time. Bm v?c arc in fjreat trouble," 
he went or, "1 really clout know what to do. Tlie angels are all busy 
taking down babies or watching over others and there are four human 
babies who have just arrived and have to be taken to their mothers. 
What shaEl we do? You know wc'rc all occupied. The worst is that 
one cant take them alone, or I might do it, but they live in different 
parts of the world, one in Chicago, one in Hong-Kong, one in Am¬ 
sterdam and one in Pelrograd; and they all liave to be delivered 
to-day C, 0. D. The charge is 10 Lbs. of liappine.ss C. O. D. Except 
the mother in China, she only pays five because tlicy doiit love girl 
babies in China as much as the boys. But as iLs the only Chinese 
vociferous here, it will have to go, 1 suppose.” 

" I'll take the Chicago one," offered Susan. 

“That's nice," cried old Santa. "Very obliging of yon I'm sure, 
The address is, 1589 Lover lane." 

“ Dont count me out of the game,” intercepted Susan. " I’ll pack 
the squallcr of China.” 

“Well that address,” said old Santa, T’is XYZ Ching Chong Joy 
Path." 

“ I’m sure I'll help too," remarked Mother Sally. '* Give me the 
little Dutchman, IVc heard that little Dutch babies aren't as noisy 
as the others.” 

"Oh yes they are,” St. Nicholas laughingly assured her, "Bi?t if 
you wish you can take charge of that fellow," and she (lew off to get 
the baby. 

"Well I guess I'll take a. chance if the others'do,” Father Sam 
decided "And as the baby Russian is the only oin'' left. I'll take that." 

" All right, that’s on Lovesky Lanesky. Deliver it lo the Countess 
Cuddlesky,” and stooping with difficulty he pasted on the youiigstei''.s 
stomach, a label bearing, “Glass,—^WilU care,” and Sammy flew off. 

"There” said old Santa drawing a big sigh of relief, " I do wonder 
when they’ll come back.” 

In a little while Susan came back. “Gracious goodness, that woman 
gave me 20 Lbs and didn’t ask for the change," she remarked as. she 
settled down beside him. 

Old Santa laughed with satisfaction. " Well she was certainly gen¬ 
erous she must be a mflUonaire at the joy bank." 

In another minute back came Susie. “You said that woman shovild 
only be charged 5L. but she handed over 25L. Let that ‘itot loving' 
stuff be forgotten, why 1 bet if 1 had waited long enough she'd have 
given me five million. 

And then came Sally. “Ten pounds did you say? She liaiided over 
ten hundred it seemed to me. Gracious they must have a million 
millions of happiness by the way they spend it. 

At last came Father. "Aren't tire Russians generous? You said 
ten pounds, didn’t you? They gave ten thousand and offered to give 
more if I'd wait a little. 

‘^I've enjoyed the trip so much,” Susan timidly hinted, 

"That I think we might” (from Susie) 

"Be the Saint's (this from Sallie) 

" Messengers.” (this from Father Stork.) 

"That’s right,” and they looked at each other in satisfaction. 
"Thai’s right" Old St. Nicholas approved, “ Wc'li lake yon into our 
service,” And ever since the storks have had no occasion to be idtel 
Moial, The only blissful joy, you know, 

Is, in making some other one’s happiness grow, 
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Stork. Family— Cicoiliidac, arc large and white except the extremi¬ 
ties of the wing tips, wlticli arc black. Their food consists of frogs, 
birds rcptils and insects. Storks build .their nests on chimneys, trees 
or high rocks. Tlie^ eggs arc while. Ils common name in Dutch 
means, 'Bringer of Good.’ 

Many of her iiociiis and .stories she has illustrated with 
colored crayon or pencil drawings. Some of these give evi¬ 
dence of considcMaltle talent. Her pictures arc nev6i copied 
directly. If she needs a model (as for some animal picture) 
she finds as many difl'ercnt j>icture,s as she can and then makes 
her own, using the. best features from each model, together 
with such changes and additions as suit her purpose. She 
draws very carefully, making many corrections; then, when 
she is at last satisfied, she traces her final outline with carbon 
paper in order to secure a neat copy, and colors it with crayon. 

Very frequently she appends to story or poem a "moral,” 
well pointed and aptly expressed. One not knowing her 
might attribute thi.s moralizing tendency to priggishness, but 
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it is really due to her playful enjoymcni of the intellectual 
gymnastics involved in generalizing a situation or incident, 

Although Betty’s compositions show a wide range of inter¬ 
ests, there is a marked preference for themes relating to 
nature. Classification of 86 poems gave the following result; 
nature poems (descriptive and appreciative), 44; reflective 
poems, 11 ; prose poems, 8 ; homely poems, or poems of every¬ 
day affairs, 7; love poems, 6 ; occasional poems (Christmas, 
election-day, etc>), 4; plays and extravaganzas (one a play 
of 1,500 words), 3; unclassified, 1. Of 65 prose compositions, 
31 are nature stories of the pourqiiol t;y'pe (“Why the bunny 
has a white cotton tail," “Why the daisy ha.s a golden heart 
and rosy petals," “Why the owl loves the moonlight," “Why 
the thistle has thorns," etc.), 25 are animal stories (in a col¬ 
lection entitled “ Stories the Alphabet Told ”), 6 are fairy tales, 

1 a narrative story of 1,500 words (entitled “Tlie Honey¬ 
moon") and 1 a detective story of 2,500 word.s. 

It is not possible at-present to make any quantitative state¬ 
ment regarding the degree of originality which characterizes 
Betty's work. Of course no one would expect to find the 
Compositions of a child of eight years entirely lacking in 
derivative character. Not infrequently one comes upon 
familiar themes and even familiar phraseology. There are so 
mavry common elements in the poetry and in the stories of all 
ages that the most creative of writers can hardly hope to 
strike many new notes. Absolutely original thoughts are per¬ 
haps even more rare in literature than they are in .science, 
because literature is older and more universal than science, 
It would be psychologically absurd not to recognize it as in¬ 
evitable that such an impressionable and sensitive child as 
Betty should draw many of her inspirations from her reading. 
Occasionally, though very rarely, lier voracious memory seems 
to have swallowed entire sentences, but there is no reason to 
believe that her borrowings have exceeded the limits of uncon¬ 
scious absorption. 

Except for slight myopia, Betty has no known physical 
defects, and has never been seriously ill. She sleeps soundly 
from 10 to 11 hours a day. At the age of 8 years and 2 
months her height corresponded to the standard for 
years, her weight to the standard for years, her grip to 
the standard for 10 years, and her lung capacity to the stand¬ 
ard for 8 p 2 years. It is perhaps because of lier unusual 
activity that she prefers to play with boys rather than with 
girls. In doll play and otlrer ordinary occupations of girlhood 
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she has shown only moderate interest. Her ambition is to be 
a physician and a writer. 

Ratings of IleUy on d6 physical, intellectual, emotional, voli- 
lional, social and moral traits were secured from the mother 
aiid from a school teacher who had known the child intimately 
since babyhood. Tlic ratings were made on a scale of 1 to 5, 

1 being defined as " very superior," 2 as " superior,” 3 as 
"average/' 4 as inferior,” and 5 as "very interior.” The 
average of the inolher’s ratings was 1.43] of the teacher’s 
ratings, 1.47. 'I'he mother’s ratings incKided only two as low 
as "average ” (those on inleliccluai modesty and comiiiimica- 
tiveness). The only rating by the te-il.cr as low as " average ” 
was that for beauty. 

Our own rating on the traits which we have had a chance 
lo observe would not differ greatly from those of the mother 
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or teacher, alihoiigh they might be somewhat lower on intel¬ 
lectual modesty and social adaptability. In neither oi these 
trails, however, docs there seem to be any marked infevioi'ity, 
if one makes due allowance for tire ilifdculties which are 
inevitable in such an extraordinary case of intellectual pre¬ 
cocity, U is probably this, chiefly, which explains the fact 
that she prefers the companionship of children wlio are either 
several years older or several years younger than herself. The 
iiiother's habit of restricting her associations with children of 
her own age has doubtless tended to confirin this natural but 
not altogether wholesome preference. There is no evidence 
that w'ben she does play with other children there is any 
marked difftculty of social adjustment. Doubtless Betty knows 
that she has lalenis which other children do not have, She 
is too intelligent to be kept in ignorance of the fact. But 
it she is conscious of her superiority she gives little evidence 
of it. The mother has tried to imbue her with the idea that 
if she has been endowed with any uiin.sual gift it is hei' duty 
to use it to make the world happier and better. “ Mother,'’ 
she said one day, " I am not proud liecause I can write verses; 
they just come them.selves. But if I could only learn to control 
niy temper, then I would be proud,” 

Betty's education has been managed by her iiiotlier, whose 
guiding principle has been the convictiem that a child's con¬ 
fidence in its own ability to think and do should be setlulously 
cultivated, She believes that the abilities of chiklreu often 
atrophy for lack of encouragement or because of the destruc¬ 
tive criticism of their elders. When Betty does a thing well 
she is commended. Spontaneity is cultivated. Her literary 
ability cannot be regarded as an artificial product of special 
training, It was her mother's ambition that she should become 
a musician. When it beanie evident that the child’s talents 
lay in another direction she was encouraged to follow her 
own bent. 



ON THE NEIH) EOR CAUTION IN KSTAHLISHING 
RACE. NORMS 


liy Aha llAkT Abmtt. Bryn Mawr College* 


In recent years liimr has a tendency to establish race 
norms on flic basis' ul nienta) tests piven to icpresciitatives 
of various races who have eniipratcd to the United States. 
The results of tests niailu of proups of children of foreign 
born parents liave been stated and comparisons made with 
the distribution of intellipcncc in groups of children of 
American born parent.s. So far as we have been able to 
ascertain except in the case of negro ciiildren* no attempt 
has' been made to clreck up the influence of factors, other 
than that of race, which miphl «iuite as well account for the 
differences which it lias been assumed were traceable to race 
alone. Particularly Is this true in regard to the part played 
by social .stalu.s. Much lia.s been written about the effect of 
social status on the uicdiaii intelligence in any group of Amer¬ 
ican children, little or nothinp has been said as to how much 
this may account for the low or high median score or median 
intelligence quotient in groups of children of other races, 
For instance Terniau' s]>eakinp of the influence of race on 
Intelligence Quolienl cites the median I.Q. for Italian chil¬ 
dren as heinp 84 nr 16 points below that usually given for 
American children, 

It was w’ith a view to determining the relative influence of 
the two factors, race and social status, that this investigation 
was begun, 

The tests used were the Stanford Revision of the Binct 
tests. Those were given hy tlio author aj)d tlie four graduate 
students whose names appear as collaborators. All of the 
students were experienced testers. In order' to insure uni¬ 
formity of gradinp all tests were marked in consultation with 
the author. 

The children in all were taken from the primary grades 

*(With Ihc assifiUUH'i* nf C. Bai'chlc. I. Nclcrcr, K. Smith, and C, 
Barnes,) 

^Suniic Dabney. A (’ninpar;iiivc Sunly rrf While and Negro Chil- 
flrcii. Jour, of App. I'sych.ii. ItU?. p. 71. 

*Tcrmaii. IiuelliKuncc of School Children, p, 5d, (Houghton 
Milllin Co.. 1919.) 
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in a single school district. Of these 191 were cliildren oE 
native born white parents, 87 were Italians and 71 were 
negroes. All of the Italians spoke English without difficulty. 

The native born white children were divided on the basis 
of social status into five groups with reference to the occu¬ 
pation of the father. The separation into groups hy occupa¬ 
tion followed Taussig's division into the five non-competing 
groups, i.e,, (1) Professional classes; (2) Semi-professional 
and higher business; (3) Skilled; (4) Semi-skilled; (5) Un¬ 
skilled, The home conditions followed closely the division by 
occupation. The last two groups, children of unskilled and 
semi-skilled workers, contained too few children to be treated 
separately. They were therefore combined. As a matter of 
convenience these children will be called throughout the " In¬ 
ferior Group,” the children whose parents fall into the skilled 
class will be called *' Average,” those of the semi-professional 
and higher, business class “Superior” and those of the pro¬ 
fessional class "Very Superior.” 

Of the Inferior group there were 43, of the Average group 
76, of the Superior group 48 and of the Very Superior 
group 24. 


TitBLE I 

Social. SO- 60- ?0- 8U- 90- UO- 120- 100-1 Above Tolal 

SLatus.5Q.9 69.9 79.9 89.9 109.9 U9.9 129,9 139.9 MO 

V. Sup. 00106 .4 6 3 4 24 

Sup. 0 0 0 0 12 17 14 4 1 48 

Av...,._ 0 1 3 2 41 16 10 2 1 76 

Inf. .. 1 3 5 9 23 1 0 1 0 43 


The effect of Social Status on the distribution of Intelligence 
Quotients. 

The outstanding characteristics of each group can best be 
seen from Table I, Over 40% of the Inferior social status 
group have I.Q.’s below 90 and only 4.6% have I.Q.'s above 
110. There are only two children of very superior mentality 
in this group. In the Average group 50% are of average 
mentality and over 25% are above average i.e., have I.Q-’s 
above 110. The curve for the Superior gtoup shows it to be 
as much better than the Average group as that was superior 
to the Inferior social status gronp. The median I.Q. is 118,7 
or 10,2 points above that of the Average group, Seventy- 
five per cent of these children have I.Q.'s above 110 and none 
have I.Q.'s below 90. A curve for the Very Superior group 
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would Ijave IwD modes, ciiic at W-llO the otlicr at 120-129. 
Seventy per coil oi ihest; chilrlrcii liavc LQ.'s above 110 and 
oI these 76% have I.Q.'.s above 120. 'ilie difference between 
ihc Superior and Very Superior .-social status groups lies not 
in Ihc proiJortion of tlie children who reacli ilO or above 
but in (lie fact that a larger proportion of those whose I.Q.^s 
pass lit) reacli 120 or tibove. 

^ Jl is interesting to note that very few chiblrcn of superior 
jiientalily were found in Ibii Inferior social status group and 
ihat only one cliild of inferior inenlulily was found in the 
Superior and Very Superior social .status groups. 

The median for die four gnjups were respectively 

92.107, 118.7 anil 125.9 or a dilTcrL-iici! of 33.9 points between 
children of Inferior and Very Superior social status of the 
same race and attending the same grades in tlie same school. 

We are well aware, as has been .stated, that previous writers® 
have emphasized the part played by social status. It is here 
cited chiefly hccause the variation due to social status is 
wider than that usually reported and .serves to demonstrate 
.ill the more clearly’ tlic jiarl that this factor may play in 
determining the distvilmlion of intelligence in any non-selccted 
group. 

The elTcct of social status on the native l)orn white group 
having been determined (he total group was divided on the 
basis of race nlone. U i.s a .significant fact that tlicre were 
too few children in the Italian and negro groujis of even aver¬ 
age social .status to vnalile us to study the combined effect 
of race and social stalu.s in thc.se groups. 

The median I.Q. for the native white group was 106.5,^ for 
the Italian group 85 and for the negro grouj)" 83.4. The native 
born white group had a median I.Q 21.5 points above that 
of the Italian and 23.1 points above that of tlie negro group. 

^Wientrob, J. and R. Tlic Influence of Environnicnt on Menial 
Ability, Jour, of Jiduc. I’sychni., 1912, pp. 577-586. Termaii, L. M. 
The Stanford Revision of the liinet-Simon Scale, Cliap, V. (War¬ 
wick and York, 1917.) Terinan. Intelligence of Scliool Children, 
pp, 188-189. (HouglUon Mimin Co., 1919.) 

iThc high median I.Q. i.s prohahly due to the fact that most of these 
children were between the aKc,s of five and nine. The range of tlie 
I.Q.'s made by the middle fifty per cent of the ciiildrcn tested by 
Terniaii was from 97 to III in’five and six year olds combined, and 
from 95 to 111 in scveti and eiglu year olds combined, Tlie average 
child might therefore lie expected to make a higher I.Q, at these ages 
than at later ages as (or instance thirteen to fourteen where the limits 
of the tjiiotiont Including the iitirldlc fifty per cent are from 90 to 105. 
(Data cited from " Stanford Revision of the liinot Tests," page 40,) 
®Thc negroes were of mixed hlood, Ii was impossible to dclcnninc 
ihe proportion of white b/ood in the case of any of these cli/lcJrcn, 
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This disparity is great aiid if it had been due to I'ace aloue 
would have demonstrated beyond a doubt the superiority of 
the native white group, but of the native white group 
came from families of Superior and Very Superior social 
status whereas 93^ of the negro and 90% of the Italian 
group came from faniifies of Inferior and Very Inferior 
social status. 

The Italian and negro children were then compared with 
the group of native bom -white children of Inferior and Very 
Inferior social status. The median I.Q. for the native white 
group was then 92 or 8,6 points above that of the negro and 
7 points above that of the Italian group. 

This difference is not due to a larger proportion of chil¬ 
dren of superior or very superior mentality in the native 


TABLE II 



BO¬ 
SS,9 

Go¬ 
es.9 

TO¬ 
TS.3 

80- 

89.9 

90- 

109.9 

110- 

llfl.9 

120- 

129.9 

1.10- 

119,9 

Above 

140 

Toinl 

Native 

While, 

horn 
. 1 

3 

5 

9 

23 

1 

0 

1 

0 

. 1,1 

Kalian... 

. 3 

11 

19 

17 


4 

1 

(1 

0 

R1 

Negro,,, 

. 1 

7 

IS 

20 

25 

1 

1 

0 

0 

71 


The effect of Race on the distribution of Intelligence Quotients. 

white group, There are five such children in the Italian 
group, tivo in the negro and one in the native born white 
group, It is due to the proportion of children in the negro 
and Italian groups whose I.Q.’s are below 80, In the native 
born white group 20,9% have I.Q.'s below 80, in tlie negru 
group 33.8% have I.Q/s below 80 and in the Italian group 
41,2% fall below 80. As all of these children live in the 
same section of the same community and attend the same 
grades in the same schools this difference both as to the 
median I,Q, and as to proportion of dull children seems to be 
racial, But the difference in median I.Q. which is due'to 
race alone is in this case at most only 8.6 points whereas 
the difference between children of the same race but of 
Inferior and Very Superior social status may amount to 
33,9 points. It is apparent that such differences bs vve have 
between the negro and Italian children and between these 

® These three groups were originally the same size namely, 29 in 
each. Other cases have been added to bring the groups up to their 
present size with a cousctiuent change in the median I.Q. of only .5 
of a point. The median I.Q., therefore, seems to represent a difference 
which is not due to the difference in the size of the groups. 
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THE PREDICTIVE VALUE OF SPIQRT INTELLI¬ 
GENCE TESTS 


By C. F, Hansisn and M. J. Rmi, Carnegie Listitute of Technology 


Just how long an intelligence test should be to insure relia¬ 
bility is a question that has been frequently raised. The use 
of intelligence tests in industry has often been hindered by 
the length of time required for giving them. The Army 
Alpha test requires forty-five minutes, the Thorncliice Com¬ 
prehensive Tests approximately three hours. An investiga¬ 
tion has been made with an intelligence test devised by the 
Bureau of Personnel Research of the Carnegie Institute of 
Technology, to determine the effect of greatly shortening the 
time of the test upon; (1) standing as determined hy the 
full time test and (2) correlation with a practical criterion. 
The results show that an intelligence test like Personnel Bureau 
Test VI can be considerably shortened with practically no loss 
oE reliability or predictive value. Accordingly an adaptation 
of the test to the time available—whether five minutes or a 
half hour—has been secured. 

Personnel Bureau Test VI is a simple modification of the 
Army Alpha intelligence test.’ Six parts of the Alpha have 
been " scrarnbled ” to make a coiitititious test, the oral direc¬ 
tions and the coniinon sense questions only being oniitlcd. 
The remaining items were arranged in “ spiral omnibus" 
form, i, e,, they become progressively harder as the test ad¬ 
vances, The whole series is continuous, since complete direc¬ 
tions covering all the classes of items appear at the beginning, 
after which the subject works steadily without interruption 
for the entire allotted time. The test in this form has been 
given to more than a thousand salesmen and office workers 
and is in regular use in the employment offices of the Westing- 
house Electric and Manufacturing Co., the W, T. Grant Co,, 
the Phoenix Mutual Life Insurance Co. and others, 

In determining the reliability and predictive value of ,sliot c 
intelligence tests, experiments haveheen’made with two groups 
of students in the School of Life Insurance Salesmanship at 
Carnegie Institute of Technology. The groups consisted al¬ 
most entirely of men between the ages of twenty-one and 

^ A description of this test has been previously published. Biiigliani, 
W. V. Some Group Tests. Psychol Bull,, Feb., 1920, p, 57. 
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forty-live, all of whom were eager to meet the requireinetits for 
success in this school. 

The testing of these two groups followed, with one modi¬ 
fication, the usual procedure of allowing four minutes for 
reading the directions and illustrations and twenty-five min¬ 
utes for the test itself. In response tq a signal given by the 
experimenter at intervals of five minutes each, the subjects 
made a checlc mark opposite the item upon which they were 
then working, The papers therefore furnished five scores, 
as follows: 

(1) Score for the first five minutes. 

(2) Score for the first ten minutes. 

(3) Score for the first fifteen minutes. 

(4) Score for the first twenty minutes. 

(5) Total score on the complete test of twenty-five minutes. 
In tlie first experiment Test VI Form A was given to the 

first group, forty-eight students, in October, 1920, The rela¬ 
tions between partial scores and total scores are shown in the 
following table of correlations: 



Total Score 

P.E, 

Score for 5 minutes. 

.88 

±.02 

Score for 10 minutes. 

.92 

±.02 

Score for 15 minutes. 

.96 

±.0l 

Score for 20 minutes. 

.97 

±.01 


In the second experiment Test VI Form B was given to the 
second group, eighty students, in January, 1921. The cor¬ 
relations between partial scores and total scores were as. 
follows: 



Total Score 

P.E. 

Score for 5 minutes. 

.89 

±.01 

Score for 10 minutes. 

.93 

±.01 

Score for 15 minutes. 

.97 

±.0L 

Score for 20 minutes. 

.98 

±.01 


The scatter diagrams showed that the close relationship- 
between partial and total scores held true of all the individuals, 
not a single widely diverging case being found. 

To test further the reliability of the shortened tests the 
partial scores were correlated with an objective criterion, viz., 
the grades obtained in all school courses taken by the students. 
According to the system in use at the Carnegie Institute of 
Technology, the school grades were translated into quality 
points, A grade of A was given four points for quality, a 
grade of B three points, a grade of C tnvo points, a grade 
of D one point, grades of E and F no points for quality. As 
each person in the insurance school took exactly the same 
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courses the total quality points were directly comparable for 
all the students, 

The conelations of partial scores with quality points earned 
in the school courses were as follows; 



Quality Points 

P,E. 

Score for 5 minutes. 

. .53 

i,07 

Score for 10 minutes.._ 

.54 

±.U7 

Score for 15 minutes.. 

.(53 

±.06 

Score for 20 minutes. 

.63 

±.U6 

Total Score. 

.62 

±.0() 


The results show that an intelligence test of only live inin- 
mes is fairly proportional to the complete twenty-live minute 
test, a Lest of ten iiiimUcs more closely proportional, By the 
use of the regression equations scores in the short time tests 
can be converted into approximate full time scores and thus 
be compared with established iioriiis. In order to get the 
intelligence score for the complete twenty-live miiiiUc test: 

Mnltii)ly the score made in five niiniuc.s hy 2,03 and add 
42; or 

Multiply the score made in ten minutes i)y 1.38 and add 
28; or 

Multiply the score made in /l/tecu minutes hy 1.15 and add 
13; or 

Multiply the score made in tu'enlv minute.^ by 1.02 and 
add 11. 

This means that the intelligence test can be made short or 
long according to the time at the disposal of the examiner. 

For practical purposes in predicting school success, the 
fificcu iiiiiiiile fe^f is just as sntisfaclory and reliable as the 
lojigcv test. Though the reliability increases slightjy witli the 
longer periods, the fast worker and the slow one alilce maiii- 
taiii their gait throughout the test. Differences in ability 
appear in the first five minutes of a test, and these differences 
in ability arc roughly proportional throughout. To continue 
an intelligence test of this character beyond a point of proven 
reliability is merely to duplicate re.sii]ts already .secured. 
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LcJirbuc.li dcr c.vffcrimcutellen Psychologic. By J. Frodf.s, S, J. Her- 
dersclie VerlaB-shaiidlung, Freiburg. Bd. I, 1916, 605 pp,; Bd, II, 
1920, 704 PI). 

These two A'olumcs constitute a remarkably complete compilation 
of psychological investigations culled from a wide and varied domain 
and done with a thoroughness typically Taitonic, The author's pur¬ 
pose was to bring together the material of experimental psychology 
as it exists to-day in a manner at once comprehensible for introductory 
work and suitable as a point of departure for advanced specialization, 
somewhat after the fashion of Tigerstedt’s Lehrhuch dcr Physwlogie, 
A glance at the wealth of matter in the book shows that the author 
has been far more inclusive than the title might indicate, for branches 
of psychology other than experimental are treated at considerable 
length. 

In the first volume Probes deals with the simpler psychological 
processes, The order of treatment is conventional. The first section, 
following an introductory chapter on the object and methods of 
empirical psychology, discusses the nature and conditions of sensation 
in general, specific nerve energies, correspondence between sensation 
and stimulus, psychophysical parallelism, and leads directly to a survey 
of the'Special senses in section two. Here we find detailed treatment 
of the sensory phenomena of each sense department. The chapter 
on vision, c. </., begins with the structure of the eye and lakes up in 
turn the psychological arrangement of visual sensations, the relation 
of color sciisation.s to the stimulus, color mixture, adaptation, indirect 
vision, contrast, after-images, the temporal course of vLsual sensations, 
color blindness, and concludes with a statement of visual theories. 
No less complete, although not so lengthy, are the chapters on audition, 
taste and smell, tactual sensations, kinaesthetic and static sensations, 
and organics. A chapter on the simple feelings closes section two. 
Section three, wliicli is devoted to perception, deals with simple and 
complex ideas (VorslcUungeu), tonal fusion, consonance and dis¬ 
sonance, visual and tactual space perceptions, and perceptions of 
time and movement. An excellent presentation of the subject of 
psychophysics is given in the next section. The development and 
practice of psychophysics from Fechner down through Wirth and 
Urban—but not Thomson!—^widi a confessed predilection for the views 
of G, E. Miiller, are outlined without undue sidesteps into points of 
controversy. Frobcs' own investigations in this department arc rc- 
feired to quite modestly in passing. A good chapter on correlation 
brings the section to an cod. Aii hundred page section on the asso¬ 
ciation of ideas completes the first volume. 

The Second volume leaves the field of experimental psychology for 
those wider domains which serve as supports for language, aesthetics, 
criminology, sociology, education, medicine, law, etc. In the first 
volume the author was well at home in his own special branch of 
study: lacking thus intimate familiarity with certain of the subject 
matter of the second volume he had the sagacity to seek expert advice 
from Facliiiidiau'r. An opening section treats of di.sturbances of asso¬ 
ciation and cerebral localization; the so-callcd higher mental processes, 
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attention, the sell, memory, reasoning, imagination, cojnc in for de¬ 
tailed discussion; over an hundred pages arc devoted to the emotions, 
aesthetic feelin'fes, mimicry, and physiognomy, well-known authorities 
are quoted at length in chapters on the will, morals, customs, religion, 
personality, mental development, and social psychology; and the volume 
is brought to a close with sonic 125 pages_ on psychopathology. A 
valuable survey for those wishing an orientation into the topics 
treated I 

This work of Frobes is unquestionably the most useful source of 
reference for general psychology which has appeared to dale. It 
would seem, however, that a Handbook of Psychology would be a 
more fitting title than a Textbook of Experimental Psychology, It 
does not attempt to be systematic and to that extent would be 
dangerous in the hands ol Uiose beginners who have no guidance from 
a particular point of view. But to those students who have gotten 
grounded somewhere in psycliology and want reliable reference to less 
familiar topics, this work will come as a tremendous coiilributioii, 
The author has selected his litcraUire wisclv and widely (some 400 
references to writings in English, 230 of which are by Americans!) 
and has not littered the pages with inverted commas, colons, and 
semicolons, which verbatim quotations necessitate, but has given in 
clear, concise form (sometimes painfully concise; ebeiiso Witasek) 
an epitome of the views of authorities cited. 

July, 1921, Clark University c. c. pratt 

FMudofHCutnfs of High School Mathematics. A Textbook Designed 
to Follow Arithmetic. By Har(x,d Ordway Rugg and John Roscoe 
Clark, both of the Lincoln School, Teachers College, Columbia 
University, Cloth xv-J-368 pages, illustrated. Price $1.80, Also 
Answer Book, 16 cents. Yotikers-on-Hudson, New York; World 
Book Company, 

Every teacher or school administrator who is interested in improving 
the educational value of the first-year high school mathematics course 
should examine this new book. Unlike many recent texts in algebra 
this one has a real excuse for being. 

The authors have assembled in this ninth grade course the most 
important mathematical tools and notions which all children should 
know. The excessive manipulation of symbolisms of formal algebra 
has been replaced by material which i.s, both from the mathematical 
and social point of view, of far greater value. Specifically, graphs, 
methods of direct and indirect measurement, the properties of the 
right triangle, and a comprehensive trcatiaciit of the concept of rela¬ 
tionship between changing quantities (i. e. functionality) have replaced 
the elaborate treatment of factoring, fractions, and operations with 
long polynomials. 

The selection of material for this course is quite in agreement with 
the recommendations of the National Committee on Mathematical 
Requirements. The authors are to be congratulated upon having 
sensed fully the best thought of the day in the reorganization of first- 
year high school mathematics courses. 

Among the unique impressions made upon the reviewer, the follow¬ 
ing stand out most prominently: 

(1) The careful explanations and development of new processes; 

(2) The wholesome omission of formal material; 

(3) The excellent presentation of word-problems; 



BOOK REVIEWS 


189 


(4) Tlie unique organization of special products and factoring' 

(5) The "timed practice-cxercises’’ for developing skill in essential 
tool processes; and 

(6) The emphasis upon the notion of relationship between variable 
quantities. 


Manhood of Humanity; The Science and Art of Human Engineering. 
Dy AnmED Korzydski. E. P. Dutton & Co., New York, 1921, 
p, 264. 

This is a book of very wide scope embracing all human problems, 
It is a study of man and the problems of humanity from a scientific, 
especially a mathematical, point of view. The author makes a plea 
for the establishment of a “Science and Art of Human Engineering" 
dealing with human problems not by means of a study of metaphysical 
essences, but of actual facts, and reduces these facts to mathematical 
laws. The author attempts to explain social problems by an applica¬ 
tion of matliematical reasoning and mathematical law, "Engineering 
is the co-ordinated sum-total of human knowledge gathered through 
the ages, with mathematics as its chief instrument and guide." 

In Ills first chapter, the author deals with a new concept of life 
and makes use of a very intere,sting mathematical analogy which 
although in the, opinion of the reviewer, somewhat overdrawn, 
nevertheless serves to bring out in a very' striking manner how the 
progress of the social sciences has lagged behind that made by the 
natural sciences. The second chapter takes up The Childhood of 
Humanity and shows how metaphysical speculation, selfish political 
philosophies and sectarian opinions have hindered the progress of 
the social sciences and thus prolonged the period of humanity's child¬ 
hood right up to the present day. In the next chapter the author 
gives an unique classification of the types of life which points out 
vividly the relation of man to other classes of life and shows how 
the great importance of mao lies in liis "time-binding capacity," This 
classification is fundamental -in the development of the author's theory, 
The entire next chapter is devoted to a systematic inquiry into the 
nature of man remarkably free from metaphysics and dogma in an 
attempt to arrive at a scientific understanding of the function and 
sphere of man. This is perhaps the most important chapter in this 
important book and the concept here developed by the author is of 
far-reaching importance in the scientific solution of Inimanity’s 
problems. 

Chapter V Wealth and Chapter VI Capitalistic Era outline the 
method of approach of the new science of Human Engineering to 
these fundamental exonomic problems. The author points out that 
economic ideas " however false and harmful, are protected alike by 
habit and by the inborn conservatism of many minds" and how these 
old ideas hinder the natural growth of our social sciences, These 
economic problems are attacked in a clear, logical way and an attempt 
is made to get at fundamental economic concepts, reducing them to 
mathematical law. This is a practical application of the author's 
theory to the field of economics. Chapter VII deals with the Sur¬ 
vival of the Fittest in a useful way and points out the difference in 
the way survival works in animals and in men. Chapter VIII, The 
Elements of Power, endeavors to explain power by mathematical and 
mechanical methods and takes up the German philosophy of power 
that had so much to do in bringing on the World War. In Chapter 
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IX, Manhood of Humanity, the author shows that a scientific basis for 
the study of the social sciences will inilialc the Manhood of Hunianily, 
when the social sciences will prevent the cnei^ics of man from being 
wasted by ignorance and selfishness, by compctilive conflict char¬ 
acteristic of beasts, but will show that these energies are more than 
sufficient to produce a high order of increasing prosperity everywhere 
throughout the world. The author gives a necessarily vague but 
suggestive outline of a phnn for science and art of Humavi Engineering 
to guide tbe large affairs of the new state of humanity’s manhood, 
This state is to be controlled by scientists and not by petty politicians. 
"The world will have uninterrupted, peaceful progress when and 
only when the so-called social ' sciences —the lifc-rcgulaUng ' sciences' 
of ethics, law, philosophy, economics,- religion, politics, and govern¬ 
ment are technologized; when and only when they arc made genuinely 
scientific in spirit and itietUod." 

The book also contains Appendix I which takes up Mathematics 
and Time-Binding; Appendix II, Biology and Time-Binding; and 
Appendix III, Engineering and Time-Binding giving a choice bibliogra¬ 
phy for each appendix. 

Manhood of Humanity i.s a valuable attempt to a true conception 
of what human beings really are—an attempt to initiate the scientific 
study of man—a science and art that will know how best to direct 
the energies of man to the advancement of human welfare. It is 
written in a dear, logical, .stimulating style and the theory advanced 
by the author will probably arouse much controversy. It is an attack 
of a very old subject from a new point of view and is a truly remark¬ 
able contribution toward the scientific study of humanity and should 
command the attention of all interested in humanity's problems. 

MAX MKENES 

Methods and /Results of Testing ScMooI Children. By Evelyn Dewey, 
E^[II.Y Child and Beardsley Ruml. E. P. Dutton & Co,, New 
Vork, 1920, p, 176. 

This book is the result of a Psychological Survey^ conducted in the 
New York City Public Schools in February, 1915, “The immediate 
purpose of the investigation was to obtain norm.s for a .scries of tests 
for New York public school children in the poorer and more con¬ 
gested portions of the city, and a basis for further study of the value 
of mental tests for improved school procedure. It was hoped that 
the results would justify the establishment of a .school clinic for 
normal children to assist the teacher in meeting the problems of indi¬ 
vidual pupils.” Accordingly, a series of tests was devi-sed to measure 
numerically five differences of performances between cliildren of the 
same chronological age and it was aimed to accomplish tlii.s by pre¬ 
senting situations requiring mental adjustments of the type that a child 
uses in adapting liiinscif to his environm<uit. The authors confess 
that although improvements could have been made at every stage of 
the investigation, they limited the changes almost wholly to the elimi¬ 
nation of tests that were unsatisfactory in some phase of administra¬ 
tion in order to avoid an impracticable repetition of the tests. It is 
perhaps significant to note that in giving the test the authors adopted 
a method in which the maximiim amount of rigidity and uniformity 
were prescribed, under the conviction that a really quantitative uicasuie 
of the child's adjustment was their goal and would justify the limits 
in flexibility which this method would imply. 
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The authors based their investigation on results obtained from Jew¬ 
ish subjects and aimed further to collect a parallel set of results In 
schools where children of other nationalities predominated. Pupils 
between the ages of eight and thirteen were tested, A large variety 
of "tests" were given to the children individually and under 
standard conditions, An effort was made to avoid the child’s receiv¬ 
ing the impression that be was being classified according to his per¬ 
formance in the tests or that he was undergoing a school examination. 
The testing was never begun until the child felt at IvDiiic with the 
tester and interested in doing as he was asked. His mistakes were 
never corrected, the te.ster maintaining an encouraging and satisfied 
manner no matter what the response.” This was not a group intelli¬ 
gence test, but an individual performance scale containing a number 
of separate special tests such as cancellation, tapping, tests of manual 
dexterity, cart construction and some tests from theTerkes-Bridges 
and from the Blnet scales. The authors give a description of these 
various tests and the directions for giving them, together with the 
methods used for working up the results. The results are treated 
statistically in the many tables and charts contained in the book, An 
added feature is a number of charts showing sex differences brought 
out by the tests used in this investigation. A home investigation of 
the children tested was also made to provide data for an extensive 
social study of the homes from which the children came and the social 
data thus obtained is contained in tabular form. To complete the 
survey, all the children tested were given a thorough physical examina¬ 
tion and this book contains tables of norms obtained in the physical 
examination of these children. 

The investigation is rather thorough as far as it goes and the work 
was necessarily slow and painstaking, but such an investigation must 
be pushed further to include larger numbers of children of all nation¬ 
alities and all environmental conditions so that satisfactory norms 
may be established and Psychological Clinics formed in connection 
with, the school departments of various cities. max m.eenes, 



NOTES 

INDUSTRIAL RESEARCH LABORATORIES 

Research facilities and the development activities of American indus¬ 
tries are to be describeil in the fortlKoming revision of BhIIcIw of the 
ffational Research Cout^cU Number 2, "Research laboratories in indus¬ 
trial establislimerts of the United States of America.’’ Only 30C such 
laboratories were listed in the first edition but it is hoped tliat several 
hundred new names will appear in the revision and tliat a more nearly 
complete reference list will thus become available. The general 
demand for the first edition of'the BuUetjn shows the wide interest 
in this subject, and the importance of having every laboratory which 
devotes even a portion of its time to research properly listed. 

The Council requests information from directors of research who 
have not already supplied it. 'Tlie following data are wanted: Name 
and address of firm, and address of laboratory; name of director of 
research; number on laboratory staff (classihed as chemists, engi¬ 
neers, bacteriologists, etc.); approximate proportion of time spent on 
research; chie{ Jincg of research; unusual features of equipment; 
research laboratory space; date of oTganization of research laboratory 
and annual expenditure for research. Confidential information is not 
desired, 

It is also requested that librarians in the service of the industries 
please bring this notice to the attention of the proper officials in their 
organizations, 

This material should be furnished as promptly as possible to the 
Research Information Service, National Research Council, 1701 Massa¬ 
chusetts Avenue, Washington, J), C, 

REPORT OF PSYCHOLOGICAL WORK IN THE UNITED 

STATES ARMY 

A complete report of the history, methods and results of psycho¬ 
logical examining in the United States Army has been recently pub¬ 
lished in the Memoirs of the National Arademy of Sciences, Volume 
15, 1921. The report is edited by Lieut. Col. Robert M. Yerkes, Cliief 
of the Division of Psychology, as an official document for the Surgeon 
General of the Army. It consists of three parts bound in a single 
volume. Part I, presenting the official history of the development of 
the service and its activities during the war, is supplemented by repro¬ 
ductions of all of the printed materials devised and used in con¬ 
ducting psychological examinations. Part II includes a complete 
account of the preparation of methods, their characteristics, and their 
evaluations as practical procedures. In Part III the results of exam¬ 
ining are summarized. 

The entire report may be obtained from the Superintendent of 
Documents, Government Printing Office, Washington, D, C„ at $1.75 
par copy. It appears in quarto Size under the title "Psychological 
Examining in the United States Army," and includes VI-1-890 pages. 

The following books and pamphlets have been received: 

Charles S. Myers. Mind and Work. G. P. Putnam's Sons, New 
York and London. 1921. pp. 175. 
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THE RESULTS OF REPEATED MENTAL RE-EXAM- 
INATIONS OF 639 FEEBLE-MINDED OVER 
A PERIOD OF TEN YEARS 


By F. Kuhlmann 


Early in 1912 the writer adopted the intelligence quotient 
method of grading intelligence. This was before Stern's mono¬ 
graph in which this method is proposed appeared.^ Results 
from the examination of 1,300 feeble-minded of all ages 
quoted at that time seemed to indicate that this ratio of 
mental age to age remained roughly constant through the 
increasing ages of the feeble-minded* It was pointed out, 
however, that this constancy required that normal or average 
mental development progress at a uniform rate from year 
to year, as measured in absolute units of measurement, an 
assumption contrary to general observation and theory. In 
1911 a ten-year program was begun of re-examining all in¬ 
mates of the Minnesota School for Feeble-Minded at regular 
intervals of two years, excluding cases over twenty years of 
age, all epileptics, and others in whom some special trait 
interfered with getting a reliable mental age. The object 
of this study was to test out thoroughly the value of the I. Q. 
method of classification, and to determine the traits of the 
mental growth curve. 

The examinations involve 639 cases from the grade of 
idiocy to nearly average normal ititelligence, and from one to 
twenty years of age. Each case was examined from two to 
five times. About a third of the examinations were made 
by the writer. The others were made by Maud A. Merrill, 
Dr. Frances Lowell, Katharine B. Graves, and Rose Ander¬ 
son, past and present research assistants. All had had ex- 

’•See Kiililmaiin, F. "Degree of mental deficiency in children as 
expressed by the relation of age to mental age.” Journ, Psycho- 
Asllienics, June, 1913. 
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tensive preparation in psychology and thorough training in 
the use of the tests. Variability of results due to different 
examiners was probably a negligible factor. 

Three disturbing factors were encountered. The first con¬ 
cerned the cases examined. A case ojice examined did not 
always remain in the institution for future re-examinatiohs. 
Some were absent temporarily at the time a re-cxainination 
was due. Others were removed permanently through death, 
discharge, or transference to other institutions. The second 
factor was the possible selective influence on grade of intelli¬ 
gence of the institution in admitting and discharging cases at 
different ages. It could not be assumed that cases admitted 
or discharged at different ages were of the same grade of 
intelligence, The third factor was the varying accuracy of 
the tests at different age-levels, and of the different revisions 
of the B,-S. scale that were used. The first examinations 
were made in 1910 with the original 1908 scale.® From 1912 
to 1917 my 1912 revision of the tests was used.® Since the 
beginning of 1917 my last revision was used. The first two 
gave on the whole quite the same results, the 1912 revision 
being concerned chiefly with standardization of procedure 
and extending the scale downwards below the age of three.* 
The last revision corrected the general tendency of the earlier 
scales of giving too high mental ages towards the lower end, 
and too low mental ages towards the upper end, and increased 
the number of tests to eight for each age group. 

The first and second of these disturbing factors could be 
met satisfactorily. The influence of the third could be elim¬ 
inated only in part. This will be considered in connection 
with the statement and discussion of the data. 

Average Yearly Increase in Mental Age 

The raw data gives a varying number of cases whose first 
examinations came at different ages, from one to eighteen 
years. Except for the disturbing factors just mentioned, the 
average mental growth curve for these inmates of the insti¬ 
tution could be at once determined by computing the average 
mental age at each age of all cases examined and re-examined. 

® See Kuhlmann, F. “ Binet and Simon’s system for measuring the 
intclHgence of children.” Journ. Psycho-Asthenics, 19U. 

* See Kuhlmann, F. "A revision of the Binet-Simon system for 
measuring the intelligence of children" Journ. Psycho-Asthenics, 
Monograph Supplements, SepL, 1912. 

* See Kuhlmann, F. "Some results of examining a thousand public 
school childreri with a revision of. the Bioct-Sinion tests." Journ. 
Psycho-Asthenics, March and June, 1914, 
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This procedure, as a matter of fact, gives a growth curve sur¬ 
prisingly close to what is obtained when the disturbing factors 
are eliminated. The number of cases at each age is large 
enough to give a fairly smooth curve in spite of the fact that 
at each age some of the previous cases have dropped out and 
other new ones have been added. The selective influence of 
the institution, as shown also by special methods of treating 
the results to determine it, is small, and negligible for most 
parts of the growth curve. The mental ages at each age, since 
the cases include all grades, include a considerable range, and 
thus partly eliminate or smooth out the varying errors in the 
mental ages due to inaccuracies in the scale at different levels. 

But these relationships change when we attempt to deter¬ 
mine the mental growth curves separately for the different 
grades of intelligence. The difficulty is increased by the fact 
that our definition of grade of intelligence in terms of the 
intelligence quotient involves us in assumptions the correct¬ 
ness of which constitutes our chief problem. We may attribute 
a certain range of I. Q.’s to a given grade of intelligence for 
any particular age, but to use the same range for all ages 
for this grade of intelligence assumes, of course, that the 
L Q. remains constant for all ages. 

Table I gives the average mental ages for five successive 
years of each group of cases whose first examinations occurred 
at the same age. This is given separately for the four grades 
of intelligence termed idiots, imbeciles, morons, and border¬ 
line cases. The manner of derivii^ these figures needs to 
be carefully noted in detail. It was done through the I Q.'s, 
as that procedure had certain advantages over that of dealing 
directly with the mental ages. The first step was to correct 
the individual mental ages found for errors due to the gen¬ 
eral tendency of the scale to measure too high or too low at 
different levels. This was done by subtracting from each 
individual mental age the amount the scale was known to 
measure too high on the average at this point. There were 
practically no mental ages at levels high enough to need addi¬ 
tions as corrections. These corrections could not be made 
safely for mental ages below four, and could therefore not 
be extended to low grade imbeciles, idiots, or to the younger 
morons and borderline cases. Our norms for these lower 
mental ages are not sufficiently well established for any scale 
to allow of any definite conclusion as to what minor degree 
of error they may still contain. The data used in making 
these corrections were the smoothed figures on the average 
mental ages found with my 1912 revision on 1,000 public 
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school children, referred to above, and unpublished data for 
my last revision. 

The second step was to compute the I. Q.’s for the ages 
between two successive examinations by taking the average 
of the one preceding and the one following. It was then, 
easier and more accurate to compute the average mental age 
at a given age from the average I. Q. than it would have 
been to work with the mental ages directly. The examinations 
did not, of course, occur at the exact ages of seven, eight, 
and so on, and to have averaged the mental ages of all cases 
classified as examined at seven, for example, might have been 
more or less niisrepresentative, as the exact average age of 
these cases could vary from six and a half to seven and a 
half years. All age classiiicatioas were made on the basis 
of the nearest birthday. The error was eliminated by com¬ 
puting the average mental age from the average I. Q., using 
the ages as exactly seven, eight, and so on, Results of 
fourth and fifth examinations of a case were thrown out in 
order to put all cases on the same basis of a five year period 
with three actual examinations at two year intervals. Data 
for ages below seven are not given in this table because the 
mental ages could not he corrected for the general tendency 
to error in the scale, in the case of the morons, for ages below 
this, 

The third step aimed to eliminate any selective influence 
of the institution there might have been on grades of intelli¬ 
gence at different ages, and also the difficulty arising from 
classifying the cases into the four grades of intelligence at 
different ages on the basis of the 1. Q. This procedure was 
as follows, (a) Computing the average I, Q, for morons,-for 
example, examined first at the age of seven, and again at 
nine and eleven, (b) Computing the average 1. Q. at eight 
for those examined first at eight, and again at ten and twelve, 
(c) Eliminating from this second group of cases lo^v or high 
grades cases so that the average I, Q. of the remaining cases 
was approximately the same as the computed average I. Q. 
at eight for the cases examined first at seven. If there was 
a general tendency of the I. Q. to change from seven to eight, 
this procedure insured having the same true grade of intelli¬ 
gence for the group examined first at eight as for the group 
examined first at seven. On account of the small number of 
cases at times for such a group, this equating of the L Q.'s 
could be done only approximately in many instances. The 
remaining step was taken to make such exact equating un¬ 
necessary. (d) The average I. Q.’s at ten and twelve were 
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found for the selected cases examined first at eight, and the 
intermediate L Q.'s computed as before for nine and eleven. 
The average I. Q. at eight for this second group was then 
placed at exactly the same as the computed I, Q. at eight for 
the first group examined first at seven. The change in the 
I. Q. from eight to nine for this second group was then added 
to or subtracted from the 1. Q. at eight to get the I. Q. at 
nine. Likewise, the I. Q/s at ten, eleven, and twelve were 
found for the second group by adding or subtracting the 
amount of change that had occurred since the previous year. 
This procedure was repeated for each group examined first 
at nine, ten, and so on. Thus the course of these derived 
1. Q.’s for each group examined first at a given age remained 
exactly the same in form as that of the averages of the 
actual I, Q.'s found in the examinations, but it might He at 
a slightly different level, in the majority of instances in a level 
not over five points in I. Q. higher or lower, . 

In this table the number of cases examined for the first time 
at a given age is indicated in the first column of figures on 
the left. The last figure under any age gives the average 
mental age for that age. The total number of cases on which 
each average is based may be ramputed by adding up the 
figures on the left. The average mental growth curve from 
seven to twenty years for each of the several grades of intelli¬ 
gence is then given in these last figures for each age. The 
following graphs are based on the average mental ages in 
Table I. 

The main features of these growth curves present but little 
that is not now pretty well known. They show that the feeble¬ 
minded do develop mentally, and at a rate in proportion to 
the grade of intelligence. This was still a disputed point at 
the time this study was begun. This rate of development 
decreases with age for all grades. The rate of this decrease 
cannot, of course, be shown with this data, as we do not know 
how much mental growth in terms of absolute units the mental 
year represents at different age levels. In the graphs each 
addition of a year in mental age is represented as equal to 
preceding additions of a year, but even so the curves decline 
with increasing age, Could they be plotted in terms of abso¬ 
lute units of growth they would decline very much more. 
This will be made more obvious below, in discussing the 
intelligence quotient. 

Age of Cessation of Mental Age Increase. Space will not 
be taken here to review in detail previous studies and di^- 
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cussions on this matter. It will be remembered that Stern® 
assumed that the age of cessation of mental development 
changed markedly with grade of intelligence, the idiot grade 
ceasing developing relatively very soon after birth, Others 
since have accepted this assumption. Recently Doll® has 
claimed that his results on the re-exainination of feeble-minded 
verified this assumption of earlier arrest for the lower grades. 
Grading his cases on the basis of the final mental ages they 
attain in reaching maturity, he summarizes as follows.’ I 

Finalmentalage,... 12345 67 8 9 10 

Age or arrest. ?? 7 11 11 12 12 12 15 15 

find myself unable to agree with Doll that his own results in 
this study will bear the interpretation given in these figures. 

®See Stern, W. “The psycholodcfti methods of testing intelli¬ 
gence.'' Trans, by G, M, Whipple, 1914. 

® See Doll, E. A. "The growth of intelligence." Princeton con¬ 
tributions to psychology, 1920. 

'' See page 76. 
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The Goddard revision of the B.-S. tests, which was used in 
this study, is not adequate for the determination of mental ages 
much below five, as it does not include standardized tests 
for ages below three. Doll’s average growth curve for cases 
with a final mental age between 6 and 7 rises markedly beyond 
the age of 12. The same is true of his next curve, for cases 
with a final mental age between 7 and 8. His curve for 
cases with a final mental age between 9 and 10, and the next 
for cases with a final mental age between 10 and 11 show a 
still more obvious rise beyond the age of 15.® In fact, ray 
own interpretation of Doll’s results would be that they do 
not disagree seriously with my present results, based on a 
larger number of cases. In considering my own table and 
graphs, it should be noted that the different grades are defined 
in terms of the I. Q. at the age of seven,—eight for the idiot 
grade. At this age, cases with I. Q.’s from 0 to 24 were 
classed as idiots, cases with I. Q.'s from 25 to 49 as imbeciles, 
50 to 74 as morons, and over 74 as borderline. The upper 
and lower limits of these ranges of I. Q.’s for these different 
grades then decreased with age, as explained above. It is 
seen that the average growth curves extending from the age 
of seven to twenty all rise to the age of fifteen at least. They 
indicate that idiots, as here defined, develop to the age of 
fifteen, inclusive, imbeciles to fifteen or sixteen, morons to 
about seventeen, and borderline cases to about eighteen. In 
other words, all grades develop much longer than Stern and 
others have supposed, and the difference for different grades 
is not nearly as great as has been assumed. These facts are 
shown even more strikingly in the I. Q. curves below than 
in the present mental age data. Since the mental age of cases 
of fifteen years or over was always divided by fifteen to get 
the I. Q,, the I. Q. rises beyond this age, when the mental age 
continues to increase, 

Frequency of Yearly Gain and Loss in Mental Age. In 
considering this question the results for all grades of cases 
will be combined. It will not be necessary to take into account 
the three disturbing factors noted above. Not correcting 
the mental ages for errors in the scale will also enable us 
to include all the results for mental ages below seven. Since 
the mental age increase for the two-year interval between two 
successive examinations is nearly always much less than two 
years, and since any two successive mental ages will both 
be affected in the same direction through the error in the 
scale, the amount of loss or gain in mental age between two 


® See page 75. 
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TABLE III 


Age 

Number 

Gaining 

Number 

Stalionaiy 

Number 

Losing 

Percent 

LoaU^ 

2 

2 

0 

0 

0 

3 

6 

0 

0 

0 “ 

4 

13 

1 

1 

7 

5 

19 

0 

.0 

HHOBH 

6 

17 

1 

1 

5 

7 

30 

0 



8 

41 


1 

2 

9 

57 

2 

2 

3 

10 

52 

2 

2 

4 

11 

47 

4 

13 


12 

35 

0 

13 

27 

13 

42 

5 

5 

IHbuihi 

14 

33 

3 

B 

18 

15 

16 

5 

14 

40 

Id 

16 

9 

11 

30 

17 

11 

6 

12 

38 

18 

16 

6 

18 

45 


compared, 91 per cent ot the lower grade cases that lose occur 
after the age of ten, while 94 per cent of the higher grade 
cases that lose occur after die age of ten. It seems, there¬ 
fore, that age is also a factor detcnnining deterioration quite 
independently of grade. 

Constancy of U%e Intelligence Quotient 

The method of determining the continuous course of the 
I. Q. from seven to twenty years from results that are lim¬ 
ited to four year periods of examinations and re-examinations 
for any given case has already been explained in presenting 
the mental age growth curves. Table IV gives the I. Q.'s 
that correspond to the mental ages given in Table I. In 
plotting the average, continuous I. Q. curve from these figures, 
however, it becomes necessary to talre into account the varia¬ 
tions between the different groups of cases whose first exam¬ 
inations occurred at given ages. The irregularities in the 
average curves are thereby at once explained. Thus, in the 
moron grade especially, the cases examined first at seven 
happen to be improving cases, and their I. Q.'s cause a rise 
in the average I, Q, curve from seven to nine, 
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These results determine certain tendencies of the I. Q. It 
decreases with increasing age for feeble-minded. That de¬ 
crease is larger for the high grade than for the low grade 
cases, Nearly every group examined first at a given age shows 
both these facts. The averages, given in the last figure under 
each age, showing the continuous course of the I. Q. to age 
twenty, reveal them more strikingly. That the I. Q. of the 
feeble-minded would decrease with age was anticipated, but 
that it would decrease more for the higher grade than for 
the lower grade cases was contrary to expectation. I shall 
show later that both these tendencies of the I. Q, follow 
mathematically from the fact of a certain type of decreasing 
rate of growth with increasing age of average normal chil¬ 
dren, when that growth is measured in absolute units of meas¬ 
urement instead of by the variable unit given in mental ages, 
The above figures do not decide the question as to whether 
the decrease in I. Q. takes place at a uniform rate for all 
ages for a given grade, or whether it decreases more rapidly 
at some ages than at others. The rise in the I, Q, beyond 
the age of fifteen is due, of course, to the fact already noted 
that the mental age continues to increase beyond this age, 
while fifteen was the highest age by which the mental age was 
divided to get the I. Q. Not considering ages beyond fifteen 
it seems from these figures that there arc no very marked 
changes in the rate of decrease of the I. Q, for different ages, 
and that the course of the I. Q. is roughly a straight line. A 
different method of treating the results, given below, however, 
shows some unquestionable age effect. Taking that part of 
the average I, Q. curve for each grade that is not obviously 
disturbed by accidentally varying gi'oups, gives the following 
average yearly decline in the I. Q. for each of the four grades. 

Borderline. 2.19 points’ 

Morons. 1.21 '' 

Imbeciles. 1.04 " 

Idiots.37 " 


® In studying the results to determine this average yearly decrease 
in the I, Q. several different methods were used for eliniinating the 
disturbing factors discus.scd at the beginning of thi.s article. These 
methods gave somewhat different figures, but all showed that the I. Q. 
decreased more with the higher grades than with the lower grades. 
Even when no attempt was made to eliminate these factors, and when 
the same range of I. Q.’s was attributed to a grade at all ages, and 
the average I. Q. computed at each age as found in the raw results 
these figures were, for borderline 2.2 points yearly loss, for morons 
1,3, for imbeciles .5, and a negligible change for idiots. 
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Idiots 
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31.19 31.68 
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The straight lines in the following graphs approximate 
very closely this average rate of decline, assuming that it is 
the same for all ages for a given grade. It will be seen in 
a moment that this assumption cannot be entirely correct. In 
these graphs the course of the I. Q, for each group of cases 
examined first at a given age is plotted separately, The small 
crosses mark the course of the average I. Q. curve. It is 
seen that this average curve misrepresents the more probably 
true curve in several instances, most markedly for the begin¬ 
ning of the average curves for the idiot and moron grades, 



Relation of Rate of Decline of the Intelligence Quotient 
to Age. It was seen already that the percentage of cases whose 
mental age decreases as they grow older increases with age. 
So far as this might be a general tendency for all cases tliis 
effect of age should be more marked for the I. Q,, for the 
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I, Q. may decrease considerably with age without causing an 
actual loss in mental age. Table V gives the percentage oE 
cases at each age whose I. Q. decreases. The results for all 
grades are combined, and include no eliminations or correc¬ 
tions for the disturbing factors considered in connection with 
some of the other questions already discussed. Correcting 
the mental ages for errors in the scale was found not to 
make any material difference. The 1. Q.'s for intermediate 
years between two successive examinations of a case were 
computed and these computed I. Q.’s were used for the 
results in this table. 


TADLE V 


Age 

NunIxirc*MS 

%decrciuins 


4-5 5-6 6-7 7-8 B-9 9-10 10-11 

15 42 58 71 122 151 186 

20 19 45 49 60 71 76 


11-12 12-13 13-14 14-15 
233 215 163 1B2 

78 75 67 66 


These figures show an unquestionable age effect on the 
decrease in the I. Q. that is not revealed in the figures of the 
preceding table. The frequency of cases losing in I. Q. in- 
efeases with age up to about eleven years, the age at which the 
frequency in mental age loss was found to increase rather 
suddenly. When the results arc computed separately for each 
of the four gr.adcs each grade shows on age at which the 
frequency of loss in I. Q; is at Its maximum and beyond 
which it declines again, just ns for the results of all grades 
taken together, For idiots this inaxiinum age is twelve, for 
imbeciles eleven, for morons ten, and for borderline cases 
seven and twelve. The average mental ages for these grades 
at these maximum ages arc 2.6, 4.1, 6.3, and 6.1 and 9.1, 
respectively. This relation of frequency of I. Q. decrease 
to age is therefore not the effect of errors in the mental 
ages due to the scale of tests. If this were the case the 
maximum frequency in loss in I. Q. should have occurred 
approximately at the same mental age. When the mental 
ages are corrected for these errors, as could be done for 
mental ages of four and over, the number of cases left for 
each age becomes rather .small for reliability. It makes no 
material difference for the borderline cases, but raises the 
maximum age for the morons from ten to thirteen. The 
correction should, of course, have made more difference for 
the borderline group than for the moron. We may conclude 
with safety only that the frequency of los.s in I. Q increases 
with age, irrespective of grade, up to a certain age. Whether 
or not this frcciucncy decline.s I)cyoiKl a certain maximum age 
is not so certain. 
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Relative Frequency of Loss and Gain in Intelligence 
Quotient. One oi the chief questions concerning the I, Q. 
has been the possibility of predicting future and final mental 
ages on its basis for the individual case. If the present I. Q. 
has been determined for a case in a given single examination, 
how well can his mental age for any age in the future be 
predicted? Unfortunately this question has been confused 
with the question of the constancy of the I. Q., with which 
it has no necessary connection. The ability to make this pre¬ 
diction does not, of course, depend on its constancy but on 
the regularity of its change in successive examinations at dif¬ 
ferent ages, if there is a change. The traits of the I. Q. 
established by the present results have complicated its use as 
a means of prediction. It decreases with age, and the amount 
of decrease for any given year is dependent on the two further 
factors of age and grade. Accurate prediction requires that 
we know not only the presence of these tendencies, but also 
their extent at each point. But, having discovered these ten¬ 
dencies, we can make corresponding allowances in predicting 
future mental ages, and thereby reduce a general tendency to 
error in prediction that would otherwise be present, The 
following frequency distribution results on the loss and gain 
in I, Q. gives a fair idea of the general reliability of the 
I. Q. when used for prediction without allowing for the 
tendencies to change that was found. Table VI gives the 
number and percentages of cases that lost or gained 1, 2, 3, 
4, etc,, points a year. In this table the results of all examina¬ 
tions are again included without eliminations or corrections. 
They are grouped according to the four grades, and irrespec¬ 
tive of age. This, of course, introdtu:es the error into the 
classification resulting from attributing the same range of 
I. Q.'s at all ages to a given grade. Since wc now know the 
general tendencies of the I. Q. to change with age and grade 
the effect this may have on the distribution will be under¬ 
stood. The task of determining the true range of I. Q.’s for 
each grade at different ages, taking the decline with age of 
the I. Q. into account, is too complicated for satisfactory 
solution. Our previous task of determining what cases should 
be classed under each grade at different ages involved only 
getting approximately correct average I. Q,’s at each age, 
which was a relatively simple matter. It is evident that the 
present procedure cannot give a materially different distribu¬ 
tion from what would result if the error in question were 
eliminated. 
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TABLE VI 




1 

-10 

—9 

—a 

—7 

—6 

—5 

—4 

—3 

—2 

—1 
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Idiots. ■ ■. 

No, 
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25 

35 
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3.6 
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22.6 


Imbeciles. 

No. 





2 

5 

6 

23 

44 

178 

235 

179 

% 





.2 

.6 

.6 

2.7 

5.4 

m 




No. 


3 

3 

11 

3 

IS 

49 

71 


133 


100 


% 


■ 

.3 

1.2 

.3 

m 


m 

m 

13.6 

m 

10.2 


No. 

5 

10 

6 


6 

43 

34 

34 

m 

25 

22 

'll 


% 

1.8 

'3.6 

2.2 


2.2 

15.6 

12.3 

12.3 



8.0 

4.0 


TABLE VI—Continued 




+1 

+2 

+3 

+4 

+5 

+6 

+7 

+8 

+9 

+10 

Av, 


No. 

19 

9 

9 


3 




2 


-.06 


% 

12.1 

5.7 

5.7 


1.8 




1.2 




No. 

114 

33 

23 

5 

2 


2 




— .55 


% 


3.8 

2.7 

.6 

.2 


.2 






No. 

95 

75 

65 

34 

13 

4 

10 

10 

2 


-.72 


% 


7.7 

6.7 

3.5 

1.3 

,4 

1.0 

1.0 

.2 




No. 

10 

17 

13 

5 

4 

3 

2 




-2.7 


% 

3.6 

6.2 

4.7 

1.8 

1.5 

1.1 

.7 






The following summaries from the figures in this table 
might serve as a rough guide in making predictions, which 
can then be much improved by taking into account the central 
tendencies of the I. Q, to decrease with age as found above.^® 

hope at some time later to discuss more fully the general prob¬ 
lem of prediction, in which the present data will be treated specially 
with reference to this nucstioii. 
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Idiots 


Imbeciles 


Per cent. 

Points Change 

Per cent. 

Points Change 

31 

1 

31 

1 

65 

2 

61 

2 

87 

3 

85 

3 

96 

4 

94 

4 

97 

5 

97 

5 

99 

6 

98 

6 


Morons 

Borderline 

Pec cent. 

Points Cliange 

Per cent. 

Points Change 

10 

1 

4 

1 

35 

2 

16 

2 

57 

3 

31 

3 

75 

4 

44 

4 

86 

5 

58 

S 

93 

6 

72 

6 

94 

7 

88 

7 

96 

8 

91 

8 

98 

9 

91 

9 



94 

10 


These figures are to be read as follows. Of the idiots 31 
per cent change less than 1 point in I. Q. a year ■, 65 per cent 
change less than 2 points in I. Q. a year, etc. It is seen from 
even this rough method of stating the results that much is 
left to be desired, Yet, we are far from justified in. con¬ 
cluding, as is often done, that the I. Q. is of no value at all 
in making predictions. And further, if predictions are to 
be attempted at all, what other procedure or method have we 
that would be even approximately as reliable as predicting on 
the basis of the I, Q.? Aside from the question of predic¬ 
tion, the I. Q. remains the most accurate and convenient 
method available for expressing grade of intelligence at any 
given age of a case. 

The Normal Absolute Growth Curve 

It remains now to account for ihe. traits of the I. Q, changes 
with age as found in the present results. The traits to be 
considered are, (1) that the I. Q. on the whole decreases 
with age; (2) that this decrease is largest for the highest 
grade cases studied, those with an I. Q. over ,75, and becomes 
smaller the lower the grade; (3) that loss in I. Q. increases 
at least in some measure with age. 

Considering the general principles of the B,-S. scale, the 
method of establishing norms and of deriving the mental age 
and I. Q., there seem to be three possible suppositions that 
might explain these general facts wholly or in part. The first 
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is that these traits of the I. Q. result directly from changes 
in the rate of growth, even when that rate of growth is 
measured in terms of absolute units. This would m6an that 
the idiot child grows at a retarded rate that kept approximately 
the same relation to that of the average normal, losing only 
slightly in relative rate wiUi age. As this retarded rate, how¬ 
ever, approaches that of the average normal, giving us the 
higher grades of subnormals, this loss in relative rate increases, 
at least up to the grade called borderline in the present study. 
It is obvious that this loss in relative rate must then decrease 
again as we approach the average normal rate still closer, 
since 'at exactly average normal rate this loss becomes zero 
and the I, Q. remains constant at 1.CK3. The correctness of 
this first supposition is so entirely improbable on the face of 
it as to really need no further consideration. 

A second supposition is that these traits of the I. Q., or 
at least the first two, may be the result of error in standard¬ 
izing the scale of tests. It is assumed that the norms for the 
tests at each age are for non-selected children, representing 
true averages of all children at each age. This assumption 
is probably not entirely correct for any scale of tests yet 
devised. The public schools have always furnished the chil¬ 
dren in question, and it is recognized that the schools have 
a selective influence on the average intelligence of the chil¬ 
dren at each age or school grade. As we pass from younger 
to older, higher and higher grades of the subnormals are 
eliminated from the schools through failure to keep up, in¬ 
creasing the average level of intelligence of those that remain. 
The effect of this process of elimination on the I. Q. with a 
scale of tests standardized with such so-called non-selected 
school children would then be as follows: The I. Q, as found 
would decrease with age for all children of true average in¬ 
telligence or less, since at each higher age the scale would 
measure a little bit more too low. It would not increase with 
age for children above average intelligence, The total decrease 
in I. Q, for a given period of y^rs, let us say to sixteen, 
would be the larger the higher the grade of case in question, 
because the higher grade cases would attain a higher final 
mental age than the lower grade cases. To make this clear, 
let us suppose that our scale of tests were standardized in 
this way for the ages of one to sixteen. Let us assume a 
group of 100 truly non-selected children at birth, from which 
one child with a true I. Q. of .70, will drop out each year 
through some such selection as the'schools exert on children 
in the schools. If norms for tests were established with the 
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remaining of these 100 children at each age, the I. Q.'s obtained 
with such tests would be .3 point too low at the age of one, 
.6 too low at two, .9 too low at three, and so on, to 4.8 points 
too low at sixteen, With such tests, the average child would 
lose 4.8 points in I. Q. in sixteen y»rs; the child with a true 
I. Q. of .75 and attaining a final mental age of twelve at the 
age of sixteen would lose 3.6 points; the child witli a true 
I. Q. of ,50 and with a mental age of eight at sixteen would 
lose 2.4 points, and, so on. Now it is more than probable 
that the schools exert this selective influence, but there is no 
data available at present to indicate exactly how much effect 
this may have had on our norms for our tests. It is possible, 
therefore, to explain the first two traits of the I. Q. of the 
feeble-minded, at least in part, on the basis of this resulting 
error in the scale of tests. I believe that the present results 
are in some measure due to this factor. The third trait of 
the I. Q. however, cannot be explained on this ground, nor 
would it explain an increase in 1. Q. with age for children 
above average intelligence. 

The third supposition that may be made to explain the three 
traits of the I. Q. is that for the average child the yearly 
increments in mental growth as measured in terms of absolute 
units decrease each year, giving the general type of growth 
curve usually assumed to be correct. I shall attempt to show 
now that this assumption explains not only the three traits 
of the I. Q. found in the present results, but also the increase 
in I. Q, found by others for drildren above average intelli¬ 
gence. This will also suggest certain other traits of the growth 
curves of subnormals and of the I, Q. that the preceding 
analysis of the results has not revealed. 

In a recent discussion Freeman*^ presents two types of 
normal growth curves either of which it is claimed would 
result in the constancy of the I. .Q. for cases developing 
at a subnormal rate. The first is the logarithmic curve, 
y=iog, X. The second is the straight line, assuming a constant 
rate of development from year to year. For each normal or 
median curve he plots a mental age curve of a hypothetical 
case so that at any age the mental age of this case is .66 of 
the mental age of the median at the .same age. That is, the 
growth curve for the hypothetical case is so plotted in both 
instances that the I. Q, remairi constant at ,66. Freeman 
does not discuss the fact that if the ratio between the median 
rate of growth and the subnormal rate, measured in absolute 

’•i The Interpretation and Application of the Intelligence Quotient. 
J. Ed. Psychol,, Jan,, 1921. 
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units, is assumed to remain constant the logarithmic growth 
curve cannot give constant L Q.’s ior subnormals. In the 
case of the straight line type of growth curve for the median, 
any subnormal developing at a slower than median rate and 
with a constant I. Q. will also maintain a constant ratio to 
the median rate of growth, when growth is measured in terms 
of absolute units, which in this case would be a year of median 
growth. Now for the logarithmic growth curve this is not 
true at all. Here these ratios, determined from the y values 
of the subnormal and median curves at each age, increase 
with age while the I. Q. remains constant. Thus, for the 
illustration used by Freeman, the figures run as follows: 

Age. 3 6 9 15 

I, Q.66 . 66 , 66 . 66 

Ratio...,.61 .78 ,80 .85 

Vice versa, if the rate of growth of a subnormal maintains 
a constant ratio to the median rate, the I. Q. cannot remain 
constant, but will decrease with age. Since we have found 
as a matter of fact that the I. Q. does decrease with age, we 
must look for the explanation in a median growth curve that 
will give this decrease in the manner found. 

It would be a relatively simple matter to determine the 
exact nature of the median growth curve if we knew the exact 
course of the I. Q. from birth to mental maturity, and if 
we could assume that the rate of development for any grade 
of intelligence above or below median maintained a constant 
ratio to the median, when rate is measured in terms of abso¬ 
lute units. We could then construct an absolute median 
growth curve that would fit the course of the I. Q, changes. 
We can determine the whole course of the I. Q. from birth to 
maturity for the grades of cases studied only by assuming 
that it declines at a uniform rate for all ages. It was seen 
above that this assumption is probably not very far wrong, 
the general course of the I. Q. being approximately a straight 
line, with a small tendency for the rate of decline to increase 
with age. We may tentatively accept also the assumption that 
the rate of growth of any grade maintains a constant ratio 
to the median rate, and then construct an absolute median 
growth curve that will fit the rate of decline of the I. Q. of 
one of the four grades of our cases, and with that median 
growth curve determine the course of the I. Q. for other 
grades of intelligence. This will show the following. (1) 
That the absolute median growth rate decreases each year, 
giving a type of curve similar to the logarithmic, but with the 
yearly increment in growth decreasing at a much slower rate 
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than for the curve y=:log. x; (2) that thii? type of growth 
curve accounts for all the traits of the I. Q. that were estab¬ 
lished in the above results; (3) that the I. Q. for grades of 
intelligence above the median will increase with age instead 
of decrease. 

I will take the moron gi'ade, assume that its I, Q. declines 
at all ages at the uniform rate of 1.21 points a year, which 
was the average rate of decline found for morons. This gives 
this grade an average I. Q. of ,74 at birth, and of .5585 at the 
age of fifteen, This gives the following L Q.’s at the different 
ages of 0 to 15, with the corresponding mental ages. 


TABLE 711 


Age 

0 

II 

1 2 

3 

4 1 

5 

6 

7 

I. Q..., 

.74 

.7279 

.7158 

.7037 

.6916 1 

.6795 

.6674 

.6553 

M. A... 

1 

.73 

1.43 

2,11 

2.77 1 

3.40 

4.00 ' 

1 

4.59 


TABLE Vll-C^ntinued 


Age 

8 

1 ^ 

10 

11 

, 12 

1 

1 

■14 

15 

I, Q.. 

.6432 

.6311 



.^48 



,5585 

M.A.' 

5.15 

5.68 ' 

6.19 

1 6.68 

7.14 

7.58 

7,99 

8.38 


To construct an absolute median growth curve that will 
give these I. Q.'s we may set the total growth during the first 
year from birth to age one arbitrarily at 100 units. Then 
,74y—100 

1-|- JL- =.7158; also, y=l00-j-x, when x equals the 
2 

increment in growth from one to two years, and y equals the 
total number of units of growth at age two. Here .74y is 
the total number of absolute units of growth at age two for 
this grade of case, and 100 is the total number of units of 

growth at age one for the median. 1-}- is then the 

mental age of this case, which, divided by 2, equals the I. Q. 
.7158. Solving for x and y, gives 84.31 units increase in 
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erowth from 1 to 2 years, and a total of 184.31 units at 2. 

.74y—184,91 

To get the increase from 2 to 3, wc have 2-j-_ 

3 

.7037, where y equals the total -number of units of growth 
at 3, X the increment from 2 to 3, and 2-^ equals 

the mental age at age 3, which divided by the age 3 equals 
the I Q. of .7037 at age 3. Here y=184.31-(-x. Solving 
again for x and y, gives 76.20 units of increase from 2 to 3, 
and a total of 260.51 units at age 3. Repeating this process, 
gives the following median growth curve in terms of abso¬ 
lute units of growth, and which will re.sult in the decline in 
the I. Q, from .74 at birth to .5585 at the age of 15, as found 
for the moron grade and given in Table VII. 

It is seen that this absolute median growth curve decreases 
from 100 units of growth a year to 20.68 units at the age of 
14 to 15. Had either of the other grades instead of the moron 
grade been chosen and the absolute median growth curve 
constructed in like manner the geneml character of this curve 
would have remained the same. We may next adopt this 
growth curve tentatively as correct, and determine the result¬ 
ant I. Q.'s for different grades of intelligence. 

Table IX gives the resulting I. Q.’s at age 10 for different 
grades of intelligence from 1.20 down to .20. in ten point steps. 
These are derived with the use of the median growth curve 
given in the figures of Table VIII. It is assumed again that 
the ratio of total units of development of any grade to the 
total median units at the same age remains constant, That is, 
if it is .50 of the median number of units at age 1, it will be 
.50 of the median at any other age. 


TABLE IX 


Grade. 1,20 

1.10 

1.00 

.90 

.80 

.70 

LQ. at age 10_ 1,45 

1.20 

1.00 

,84 

.70 

.57 

No. points change + ,35 

-h.io 

0 — 

-.06 

—.10 

—.13 


TABLE IX—Continued 




Grade. 

.60 

.50 

.40 

.30 

.20 

I, 0. at ape 10. 

.46 

.37 

,28 

,20 

,13 

No points change.. 

. —.14 

—.13 - 

-.12 

—.10 

—.07 


This shows that the median growth curve that results in 
the I. Q. changes with age as found with morons will give 
the 1, Q, of other grades, in general, as found by our actual 
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re-examinations of cases. The I. Q. decreases for the lower 
grades, and more for the higher grades, up to a certain point 
beyond which this decrease becomes smaller again, reaching 
zero, of course, for the median grade of l.OO. It also shows 
that the 1. Q. for grades above the median increases with 
age instead of decreases. The maximum -decrease in Table 
IX is at grade ,60, while as actually fouitd in the re-examina¬ 
tions the I. Q. for borderline cases decreased most, The 
present data are not adequate for determining at just what 
grade this maximum decrease in I. Q, occurs with the true 
median growth curve. The median growth curve constructed 
to fit the moron grade may be more or less incorrect, because 
(a) the average yearly decline of 1,21 points for morons may 
be somewhat incorrect; (b) the decline may vary with age 
more than is assumed here; (c) the ratio of the subnormal 
rate of growth to the median rate of growth may not remain 
constant. It can be shown as a matter of fact that this growth 
curve is probably considerably wrong, by computing the I. Q.’s 
at each age from 1 to 15 for the idiot, imbecile, and border¬ 
line grades, for this median growth curve, and then compare 
these I. Q.’s with the I, Q.’s of these grades as actually found. 

When these computations are made it is found that the 
present median growth curve gives I. Q.'s that are increasingly 
,higher, from 1 to 15 years, than the I. Q.’s as found for the 
borderline grade, and increasingly lower than the I. Q.'s as 
found for the imbecile grade. For the borderline grade, this 
difference is -)-.28 points at the age of fifteen. In like man¬ 
ner, the median growth curve that fits the moron grade as 
found does not correspond with the median growth curve that 
fits the 1. Q.'s of the borderline grade. 

This lack of correspondence must be due to one, two or all 
three of the factors just noted. If the first two factors are not 
sufficient to give the amount of discrepancy found here, we are 
forced to the important conclusion that the ratio between 
median rate of growth and any subnormal rate does not remain 
constant. In that case it would become necessary to deter¬ 
mine the growth curve for every grade empirically by re¬ 
examination at successive ages in order to establish the gen¬ 
eral tendency for each grade in more detail than the present 
results do. 

The median growth curve constructed so as to give the 
course of I. Q, changes as found for morons cannot show 
what changes with increasing age in the rate of decline in the 
I. Q. may take place for other grades, as it is based on a 
rate of I, Q. change that remains constant at 1,21 points loss 
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per year. But, having once established the general type of 
median growth curve that is required to explain the main facts, 
we may try out modifications of the curve which are con¬ 
structed in other ways. The present results indicate fairly 
definitely at what age mental development ceases. The median 
growth curve used above shows that the number of units of 
yearly growth decreases at a somewhat increasing rate with 
age, but it results in no radical modification of the curve to 
let it decrease at a constant rate. Assuming now a constant 
rate of decrease in the number of yearly units of growtli, and 
placing the cessation of mental development at the age of 
sixteen years, gives a yearly decrease in rate of 6.25 units, 
when the total number of units of growth from birth to age 
one is placed again at 100. This results in a total of 844 
units at fifteen instead of a total of 744 units for the median 
growth curve used above. Computing the I. Q.’s at different 
ages for different grades of cases that result from this median 
growth curve gives a marked increase with age in the rate of 
decline of the I. Q. for the higher grades of subnormals. 
Below grade .40 the rate of decline of the I. Q. becomes 
practically constant for all ages. This is seen in the fol¬ 
lowing figures, omitting fractions. 


Age 

1 

4 

TABLE X 

6 8 

10 

12 

14 

16 

Av. Yr. 
L6ss 

Grade.. ,90 

.90 

.89 

.88 

.86 

.84 

.81 

,77 

.70 

1.31 

" .80 

.80 

.78 

.76 

.74 

.71 

.68 

,63 

.57 

1,63 

" .60 

.60 

.57 

.55 

.52 

.49 

.46 

,42 

.38 

1.47 

" .40 

.40 

.37 

.35 

.33 

.31 

.29 

,26 

.23 

1.13 

" .20 

,20 

,18 

.17 

.16 

.15 

.13 

.12 

.11 

.60 


The average yearly loss in I. Q. that results from this 
median growth curve is given in the last column of figures 
on the right. It is seen that the nwximum decline occurs for 
grade ,80, twenty points higher ffian for the median growth 
curve that fits the moron grade I. Q.^s. In other words, a 
relatively small change in the exact nature of the median 
growth curve shifts this point of maximum decline in the 
I. Q. over a wide range. The following graphs are for the 
figures in Table X. 

Summary 

1. The mental ages of the feeble-minded increase with age 
at a rate proportionate to the degree of mental deficiency. 

2. On the whole, the mental age ceases to increase between 
the ages of fifteen and eighteen, the idiot grade ceasing develop¬ 
ment about three years earlier than the borderline grade. 
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lose from one to seven mondis a year in mental age. 

4. The lower grades lose more frequently in mental age 
than the higher grades. 

5. The frequency in loss in mental age increases with age, 
independently of grade. 

6. The intelligence quotient decreases with age, and more 
for the higher than for the lower grades. In the present study 
the average yearly decrease is 2.19 points for the borderline 
cases, 1.21 for morons, 1.04 for imbeciles, and .37 for idiots, 
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7. The rate of decline of the intelligence quotient increases 
some with age. 

8. The several traits of the intelligence quotient are all due 
chiefly or possibly entirely to a decrease with age in the 
yearly increment in mental growth of average normal children, 
as measured in terms of absolute units, and follow mathe¬ 
matically from the nature of this median rate of growth. 
They may in some measure be dvie to the scale of tests meas¬ 
uring increasingly too low with increasing age, because this 
scale is based on the average abilities at each age of school 
children from which the lower grades have been more and 
more eliminated by the schools with increasing age. 

9. It is probable that even if mental development were 
measured -in terms of absolute units of growth the ratio be¬ 
tween the median rate and any other rate above or below it 
will not remain constant from year to year. 

10. The intelligence quotient of cases above the average 
will increase with age instead of decrease, for the same reason 
that it will decrease for cases below average. 



PICTORIAL COMPLETION TEST IP 


By William Healv, Judge Baker Foundation, Boston 


Introduction 

It seems clear that any fair attempt to measure intelligence 
must include well-directed estimations of apperceptive abili¬ 
ties. Surely the capacity for "putting two-and-two together" 
in the realm of thought, the ability to "turn things over in 
the mind/' to "rationalize” about perceptual material with 
what may be drawn on from the ideational and other memory 
stores of the mind is of the very essence of intelligence and 
of very great importance in civilization. This, if anything, 
may be spoken of as a hi|rher mental power. 

My interest in a pictorial completion test dates from appre¬ 
ciation of the probable great value of testing apperceptions 
and from the realization that the language completion test 
(as used by Ebbinghaus and developed since by others) in¬ 
volves several features which interfere greatly with its early 
intended use as a test for apperceptive abilities, First, there 
is the outstanding fact of the immense' differences in the 
opportunities of individuals for acquiring facility with the use 
of our language, not only differences in formal educational 
advantages, in family and other cultural opportunities, but 
also, here in America, in the extent to which English is actually 
spoken at home or—as unfortunately with some of our immi¬ 
grant peoples wedded to their own institutions—even in school. 

^ This test was exhibited first at the December, 1917, meeting of the 
American Psychological Association. Soon afterwards the War De¬ 
partment requested the use of it, and, of course, further publication 
at that time concerning the test became undesirable, even of the scor¬ 
ing values and norms which were at once worked up for the purposes 
of the Army psychological examinations when the test became part of 
them. Then the illustration was copyrighted in its several parts 
in 1918 in attempt to prevent the unfortunate newspaper publicity 
which befell my first Completion Test. The Judge Baker Foundation 
(40 Court St., Boston) has recently undertaken to have the test con¬ 
veniently mounted and boxed and obtainable for a reasonable price. 

(Since this article, including llic above foot-note, was written, I 
have observed tliat this test, including the small plate of the whole 
series of pictures, which we have purposely refrained from publishing 
ourselves, and a copy of the scoring values calculated by us, has been 
published without any mention of authorship in a book entitled, " Army 
Mental Tests," by Yoakum and Yerkes; Holt & Company,) 
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On account of this total situation it is impossible to utilize 
the language completion test as an apperception test equally 
fair for all. 

And whenever the verbal passage becomes really difficult, 
as in the harder parts of language completion tests, unusual 
words and those with special shades of meaning increase the 
difficulties for interpretation of the test results, throwing the 
advantage strongly to the individual who has had specially 
good training in language. 

Second, I stated my conviction long since, giving instances 
bearing on the point, that language ability was to be regarded 
as a specialized ability, sometimes very poorly correlated with 
the findings on. other intelligence tests. We now have con¬ 
siderable data bearing on this. Just as one may possess to 
a superior or very inferior degree the power of musical 
expression, so language may “flow trippingly “ from the mind 
or one may by nature halt with words. In the direction of 
either extreme there is vitiation of the language completion 
test as indicative of apperceptive ability in general. 

Third, the number of details necessary for a desirably 
complex situation for testing apperceptions can only be pre¬ 
sented to a reader at the expense of taking considerable time 
for the reading and, through this, there is involved another 
well-known variable, the memory powers or memory span, in 
this case the memory span for ideas, as they are represented 
one after another in a long passage. 

It suggested itself, then, that a picture completion test 
might be much fairer as a test for apperceptions, eliminating 
to a large degree the factors of trainihg and of special ability 
or disability in language which, as a mode of expression, could 
be only incidental to the main purpose of the language apper¬ 
ception test. And a well devised pictorial test certainly would 
give opportunity for presentation of a wealth and exactness 
of ideational detail at a glance which would require pages of 
text adequately to cover; as complex a situation as desirable 
could be depicted without any strain on the memory or any 
troubled traveling of the attention back and forth, as over 
the printed page. 

- In a picture we could present ideas of a simplicity compar¬ 
able to those of a simple short sentence, or one could illustrate 
situations too complex for any ordinary rapid solution. And 
then, as I demonstrate in Pictorial Test II, by the use of the 
serial pictures one can carry along ideas as they were carried 
along in the earlier language completion tests where words 
were elided from a narrative of some length. 
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Ideas from which to choose in filling the spaces of incom- 
pleted sense are represented by a stock of small pictures, and, 
as one selects verbal ideas froni his mental stock in the lan¬ 
guage completion test, one chooses pictures to fill in what has 
been cut out of the main illustration. 

Development ov the Test 

The first pictorial completion test which I devised some 
years ago^ soon became widely used and commented on, par¬ 
ticularly in the monograph devoted to it by Pintner and 
Anderson.® That it seemed to others to embody a sound idea 
for a good mental test, and that this first picture showed itself 
to be crude in several features, both for interpretation and 
scoring, stimulated me to develop plans for a much better 
test, of the same sort, one that should involve both easy and 
decidedly difficult problems for apperception. This appeared 
to be possible by thinking out a pictorial narrative, series of 
pictures with elements for interpret^ion carried over from 
one picture to another just as elements of significance for 
understanding a narrative are carried over from a sentence 
or paragraph to later passages, easy or more difficult 

The fact that this idea for the test has not been carried 
out by others is vei 7 likely due to the difficulties and the 
amount of effort involved.* For the development of a series 

* Described in The Psychological Review, May, 1914. 

8 The Picture Completion Test, by Rudolf Pintner and Margaret 
M. Anderson, pp. 101; Warwick and York, Baltimore; 1917, 

*AII told, a very considerable task has been involved in the develop¬ 
ment of this second pictorial test, an effort quite beyond the ordinary 
capacities of any one or two persons. It has been through the fine 
cooperation of a group, the members of which have given without 
stint of their time, that the work has been done. Dr. Bronner has 
been foremost in advice and effort at every stage of the practical 
development of the te.st. Indeed, three of the eleven parts of the 
picture are entirely her suggestions, embodying better ideas than I had 
been able to advance, The illustrator, Miss Marguerite Davis, brought 
to the task unflagging zeal as well as artistic skill. The important 
mathematical suggestions and computations for scoring values were 
made by Mr. Herbert Sturgis. The entire staff of the Judge Baker 
Foundation gave itself over to obtaining results on the test both on 
many trial pictures and on the test as completed, for the establishment 
of norms, And groups of various nationalities and ages and grades 
of educational advantages were tested. Much work was undertaken 
in the interests of the army psychological service during the early part 
of 1918 ij] order to establish values for scoring and norms of perform¬ 
ance for various groups on this test. Very valuable service in this 
was rendered by Margaret Fitz and May Bere. A number of outsiders 
also aided at differejit stages, a notable amount of work being done 
by Miss Katherine Coveney. 




Plate I 

Sketch from the colored illustration o( the simplest picture in the 
aeries, the demonstration picture, with the inserts which particularly 
relate to this picture, Of course only one is quite correct, but the 

OthArS can h(> I'nSAr^AH ui'fk etiAW aF ktm-, nc-r 
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of satisfactory ideas a considerable task is demanded of the 
psychologist, preceding combined work with'the artist. One 
of the main practical obstacles is found in the necessity for 
devising the correct proportionate size and an insignificant 
background for all the elided parts, so that there shall be no 
fitting in of the pieces according to the form of the piece, or 
by joining together parts of the picture. So far as the size 
of the pictured object for placement and the immediate back¬ 
ground is concerned, any one of the related stock of idea- 
objects must seem reasonably placeahle in any one of the 
spaces to be filled. Then, too, the carrying over of a central 
idea from picture to picture with broad illustrative concep¬ 
tions, but with an exactness of representation that shall satisfy 
critical interpretation is no easy matter. 

Description 

Pictorial Completion Test II consists of an illustration to 
be divided for convenience into two or three parts when 
mounted. It is composed of a series of eleven pictures SxSyi 
inches each (one, very simple in idea, merely for demonstra¬ 
tion purposes), representing in sequence situations or events 
occurring during a day in tnc life of the boy who is depicted 
in each picture. From each picture there is a piece cut out, 
one inch square; the picture to be completed by selection of a 
square from the accompanying sixty small illustrations, only 
one of which represents the object which is needed to exactly 
fulfill the idea of the given picture. In every instance several 
of the small pieces depict objects designedly logical in part 
according to whether various ideas suggested by the given 
picture are taken into account, but not wholly correct, and 
hence may partially comply with the requirements for think¬ 
ing out the situation as pictured. «A few of the inserts are 
purposively suggestive. Of course, most of the sixty small 
pieces are quite inconsistent with the logical needs of any 
given one of the eleven pictures. 

The ten test pictures present situations planned to be of 
greatly differing difficulties of solution, and they have worked 
out so well that children of eight years generally get a credit 
score, while many adults, even of very superior achievement, 
find it difficult to achieve a perfect score. 

The drawing of the illustrations is satisfactory and the 
bright coloring stands out well as done by the three-color 
process. The picture is varnished and should be mounted on 
three-ply scroll-.saw wood. The sixty pieces are to be num¬ 
bered on the back for scoring purposes and are given standard 
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placings for presentation, according to numbers to be placed 
on the floor of the box in which they are kept. The pieces 
which with some reason might belong in any given picture 
have a certain amount of grouping in our arrangement so that 
the search for related “ideas'* may not be unduly difficult. 

(For those who get the illustration not cut up it should be 
stated that the numbering of the 60 pieces proceeds from the 
left top across the page and is repeated for each one of the 
six lines of 10 pictures. Thus, No. 1 is the sci.ssors, No. 10 
the picture and frame, No. 60 the top. Of the larger pictures, 
the hoy getting up in the morning is the demonstration piece; 
No. 1 is the breakfast scene; No. 2, on the way to school; 
No. 3, at the school house steps; No. 4, the dressing room; 
No. 5, the schoolroom; No. 6, boys looking up at the sky; 
No. 7, the street scene with the policeman; No. 8, returning 
from the baseball game; No. 9, two boys on the side-walk; 
No. 10, evening scene in the home.) 

Directions 

The entire picture, parts 1 to 5 forming the top row and 
parts 6 to 10 below them, should be placed in a good light 
before the subject. The sixty small pieces in the stnndai-dized 
arrangement are presented in the most convenient place where 
the subject may see them well. 

The procedure is then very simple, but should be according 
to mid. For very dull persons repetition and increased em¬ 
phasis of the following verbal directions may be needed. 

" Here is a picture—it begins here ” (pointing to demonstra¬ 
tion picture) "where tlie boy is getting dressed. It shows 
the same boy, remember, the same boy, doing one thing after 
another during the same day." (Point along the first row, 
then along the second, to indicate clearly the sequence in 
which the pictures come.) "You see in each picture a piece 
is missing. Here ” (pointing to them) " are a lot of small 
pieces, they fit in any of the spaces. But there are more pieces 
than you can use. The point is to pidc out the piece that you 
think is needed, that is best, to complete the sen.se of the 
picture. For instance, What is gone here?" (pointing to 
demonstration picture). "Yes, a shoe." If incorrect answer 
is given, which is very rare. Examiner says, “ No, he is dress¬ 
ing and he is stooping for his other shoe.” " Now, which is 
the shoe that he must have?" If correct shoe is selected 
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Examiner says “Yes. This one” (pointing to low shoe) 
" wouldn't be right because he must have a high shoe to match 
the other one.” 

” Now, that is the way each is to be done. There is always 
some piece that is the very best one; you can tell which it is 
by studying the picture. Now go ahead.” 

The wain point is to give no help after the first explanation. 
Nothing -further is said while pieces are being inserted except 
that examinee, if he asks, is told that he may change pieces, 
After all empty spaces have been filled examiner asks if 
examinee is quite satisfied, if not, he is told that he may make 
further changes. When examinee indicates that he has fin¬ 
ished as well as he can, time is recorded. 

Only the final placings are scored, but record may be kept, 
if desired, of the changes. Next to the numbers of the pic¬ 
tures in order may be recorded the number or name of the 
piece inserted. 

Twenty minutes is maximum time allowed,® 

The total score on the test is the sum of the values of the 
pieces as finally placed. If all are correct the score is 100, 

Scoring Values 

The value of minus 5 is to be given to all placings where 
in the table below no numbers are inserted. These placings 
represent marked absurdities. The numbers in bold type are 
for correct placings. 

Questions will determine in suspected cases whether a cor¬ 
rect placing has been accidental. It happens rarely, as when 
the correct window in IV is placed, although “ any window 
will do,” The score of that placing, obviously, should be no 
more than the verbal judgment calls for, e.g,, the value of an 
incorrect window in IV. 


® In the army examinations only 10 minutes was allowed on account 
of necessity for saving time. This was rather unfortunate, although, 
as a matter of fact, it is decidedly rare that longer than this time is 
desired by the subject. However, the differences that there may be 
i.s shown fay the fact that one of the most brilliant men in America 
took the full 20 minutes and wanted more in which to finish Picture 
10, finally leaving a piece in place that gave a total score of 90—the 
relation of the sewing to the meaning of the picture he had not yet 
apperceived. 
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TABLE I 

Values of Pieces as Placed in Pictures I to X 























































































































PICTORrAL COMPLETION TEST II 233 


TABLE I—Continucid 



The above scoring values were computed Erom the results 
obtained by testing 1^542 individuals consecutively, all of them 
presumably of normal mentality. We did not include records 
of the feebleminded or psychotic." 

The task of working out proportionate scoring values of 
correct placements upon the basis of all pieces accurately 
placed, giving a score of 100, was assigned to Mr. Herbert 
Sturges. He worked first with a series of 257 records and 
then with 1,542, including the first 257. The resultant values 
differed very slightly for the two series, indeed, five of the 
correct pieces remained practically unchanged, less than .5 each, 
the greatest alteration being from 12.35 to 11.24 as the value 
of the correct placing in picture 3. 

The method applied to the problem was that of weighting 
each correct solution inversely to the frequency with which 
it was correctly solved. The working out of the method is 
as follows: Opposite each frequency write its reciprocals; find 
the percentage that each reciprocal is of the sum of the re¬ 
ciprocals. 

The rule stated is: Value a for problem A is the percentage 
that the recipiOcal of the frequency of correct solution of A 
is of the sum of the reciprocals of all the frequencies of correct 
solutions. 

* Here I wish to acknowledge the value of Pintner and Anderson's 
criticism concerning the inadequacy of the scoring methods and norms 
for my first completion test. In turn, it was this criticism that chal¬ 
lenged Dr. Bronner and me to attempt to develop a less clumsy system 
of scoring than tlie one devised by these authors. The main point 
they make is thoroughly valid; many testa do need standardizing for 
age and other groups. But on all except group tests the necessary 
labor—over a thousand hours were devoted to standardizing this our 
present test—and the requirement for much cooperation stands in the 
way. 
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TABLE II 




Values for a Series of 1542 Records 




Fercentage 

Reciprocal of 




Correct 

of total cor¬ 

Score 

P, E. of 

Picture 

Placings 

rect placings 

frequency 

Score 

1 

1130 

14.44 

0.000^ 

6. (5.77) 

0.06 

2 

655 

8.37 

0.001527 

10. (9.96) 

0,20 

3 

580 

7.41 

0.001724 

11. (11.24) 

0.25 

4 

363 

4.64 

0.002755 

18. (17,96) 

0,56 

5 

925 

11,82 

0.001086 

7, (7.08) 

0,10 

6 

6B3 

8.73 

0.001464 

9.5 (9.55) 

0.18 

7 

1228 

15.69 

Q.QQ08U 

5.5 (5.31) 

0.05 

8 

416 

5.32 

0.002404 

15,5 (15.67) 

0.46 

9 

1325 

16.93 

0.000755 

5, (4.92) 

0.03 

10 

520 

6.65 

0.001923 

12.5 (12,54) 

0.30 

Totals 

7825 

100.00 

0.015337 

100.00 



The question of giving values to solutions other than the 
one correct solution of each pictui'e could not be answered by 
inatheinatical considerations based on the frequency of such 
solutions. Arbitrary determinations anbodying as much com¬ 
mon sense as possible were invoked, No approach to correct¬ 
ness, it was felt, could be worth more than half as much as 
the correct solution, So the pieces which were planned to 
represent ideas similar to the single correct piece but missing 
the real point were given values of half or a little less than 
half. Thus the value for correct placing, the red book, in 
Picture 2 is 10 [the nearest half decimal to 9.96). But if one 
finally chooses the blue book or the two books or the lunch 
box or the box of pencils the scoi'e is 5. Of course it could 
be nothing else than the red book if one apperceives the situa¬ 
tion, the boy having dropped something out of his strap, and 
his books, plainly colored, being shown strapped together in 
the previous picture. The only other possibility is a foot¬ 
print on the ground, and that receives a score of 2. In the 
other pictures the commonsense of the situation and the pos¬ 
sibilities differ and various arbitrary rulings concerning scores 
have been made accordingly—always based, however, on the 
original computations of correct scoring values. 

If a piece of indifferent meaning, such as a blank in Pic¬ 
ture 2, is left in place, or if, as extremely rarely, the space.is 
left unfilled it has been decided that the score should be 0. But 
a large share of the possible placing are obvious absurdities 
and logically should be penalized. It is pretty clear just which 
these absurdities are. It was decided that minus 5 should be 
the standard score for these absurdities. 
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Though the scoring of these latter classes of placings is 
thus numerically arbitrary, still it must be remembered that 
the scoring as a whole is based upon mathematical computa¬ 
tions of fair values according to ascertained relative differences 
in performance and that once this was done, the minor values 
as established are as fair for one person as another. (Of 
course I realize the suggestion vtilue or the association value 
of any piece is never the same for one person as for another, 
but the same, might he said to a greater or lesser degree about 
almost any mental test.) 


TABLE 111 

Percentiles from the Above Chart 


Ages 

7 

S 

9 

10 

11 

12 

13 

14 

15 

16 

17-20 

20-50 

75 percentile 

24 

41 

48 

59 

63 

66 

69 

72 

76 

75 

78 

78 

M^ian 

9 

27 

37 

47 

54 

55 

56 

62 

64 

66 

65 

65 

25 percentile 

-6 

7 

23 

32 

41 

45 

50 

52 

54 

54 

54 

54 


Specicl editcaiional advantages. Whatever the findings for 
those who have liad educational advantages above higli school 
it would hardly be safe to allege that any good score would 
be due to such advantages rather than to native ability. It is 
more than conceivable that a considerable number of those 
who go further with their schooling do so because of their 
already demonstrated ability. Nevertheless it was felt to be 
much wiser to keep separately the 231 records of this group, 


IV 

No. of Subjects 
57 
54 
47 
42 
21 
8 
2 

231 

75 percentile = score of 90 
M^ian score of 80 
25 percentile = score of 68 


TABLE 
Scares Obtained 
91-100 
Sl-90 
71-80 
61-70 
51-60 
41-50 
31-40 


It is interesting to compare these much higher percentiles 
with those of the main group. And then it should be stated 
that a perfect score was obtained by 25 (11 per cent) in this 
last series as against only 4 (1.2 per cent) of 320 of the same 
age-group (above 17 years) in the main groups. 
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Norms of Perfobmance 

Ag^-groups ^ 

Figure 1 

Age distribution of total scores, 160 for each age-group (records of 
the feebleminded and of those with educational advantages above high 
school arc not included). 
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While complete significance cannot, of course, be given to 
the findings for age-periods with the higher educated group 
on account of uneven and too few numbers, yet it is striking 
that 20 per cent of 65 individuals 35-50 years of age gave 
perfect scores and that their median score was 85, while 7.3 
per cent of 164 with ages 19-35 did perfectly, with a median 
score of 76. It would seem as if among well educated people 
youth did not have the best of it in this test. 

The Mentally Defective. Records of the performance of 
the feebleminded on any one test show the futility of attempt¬ 
ing to establish for any single test norms which are char¬ 
acteristic of the mentally defective. Mental defectives differ 
greatly among themselves in their special capacities and in 
other important features of mental life than are expressed 
by general age-level ratings on a given “ intelligence scale." 
Some are feebleminded because of certain defective memory 
powers, others with good memories have poor reasoning ability, 
some show great unevenness in their mental powers, some are 
below par evenly in their various mental capacities, When 
really good chapters on analytic psychology of mental defec¬ 
tives shall have been written, we may learn something of the 
complexity that most certainly exists in the mental life of the 
feebleminded, which to many seems a simple affair. As it 
stands, we should scan the records of defectives in general 
on any special te.st with the knowledge that they represent the 
performances of individuals with age-level ratings differing 
widely from actual age experiences and from varying world 
experiences. Or the records may come from those who are 
not clearly feebleminded except insofar as social behavior is 
concerned (institutions for defectives sometimes retain such 
cases) or from schizophrenics who are not infrequently held 
among the feebleminded. 

Even on a test involving such complex mental functioning 
as the one under consideration we may find great differences 
among defectives, at least of the higher grade, who have equal 
rank on age-level scales. However, the ordinary observation 
that some show clear mental grasp (apperception) of their 
own disabilities and various other practical situations, and 
other defectives of equal age-level rating by the Binet scale 
Or its modifications fail thus to size up the real situation in 
regard to themselves and other affairs, ought to make the 
fact of their mental difference in this particular altogether 
plain and suggest at the outset that their scores on a special 
test for apperception might differ widely. 
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Other Groups. From records obtaiuccl by way of experi¬ 
ment, but too few for safe deductions, wc have noted several 
suggestions for speciul studies. Persons who have seen very 
little of books and are wiaccustomcd to obscrz'c pictures un- 
derstandingly or very little in any way, all of them being, 
with 115, illiterate foreigners, were at a great disadvantage and 
clearly could not interpret the sky or the interior of a room 
as such, to say nothing of finer points in tlie pictures. Psy¬ 
chotic individuals have made all sorts of records, as may be 
supposed—any study of their performance would have to be 
by types and stages of psychoses. The apperceptive ability 
of old age is a matter of special interest and perhaps might 
turn out to be of great practical importance, because of the 
value that is given by tradition and social usage to tlie opinion 
of men of age, especially as they function on tlie bench or 
in administrative positions. 

Discussion 

The universal interest evoked by the test is readily under¬ 
standable, As a series of incomplete pictures it challenges 
the performance of everyone, for even thb, mentally defective, 
above low grades, see enough of the significance of what is 
depicted so that they become interested anil are able to score 
as having observed correctly and reasoned correctly about 
some of the material in the pictures. An opportunity like 
that of everyday life is afforded tliem for some sort of not 
altogether unreasonable performance. In this, namely, in 
developing a test that in given situations for apperception 
should have simpler elements capable of being readily rational¬ 
ized by very immature minds and at the same time embodying 
features of much greater difficulty, up to those relationships 
which require close thought by competent reasoners, one of 
the foremost aims of this test has been realized. And it is 
a fact that even the cleverest, when they note the possibilities 
of interpretation, enjoy working out the problems of the test 
as tasks calling for good effort.’ 

The ideas as depicted in the pictures finally drawn are so 
clear that they present no logically equivocal issues. This has 
been proved for us not only by the records of performance, 
but also by the comments of those doing the tests and their 
acknowledgments as they have later seen the point for correct 
solution; even after having themselves earlier failed to apper- 

^We have just heard that the rvork -with French children on this 
lest as done by Marion Pilpcl through Simon's clinic in Paris has been 
very satisfactory. The situations have been rs^dily grasped by these 
childien. 
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ceive some essentials. Indeed, it is interesting to note that 
in the two pictures awarded the highest values because of 
the jnfrequejicy of their correct solutiojis, the correct insert 
is indicated with more exactitude by objects clearly shown in 
the main pictures than is the case in any of the other pictures. 
There is less chance of equivocation in these two pictures 
because the possibilities of solution, once grasped, are so 
immediately related to the factual necessities of the situation, 
The most common failures, then, are directly perceptual and 
inferential in character, involving faulty observation or faulty 
reasoning concerning objects and phenomena universally known 
and among the most plainly observable in the illustrations. 

In even the simplest analysis of the test, as a test measuring 
somelhing much more than primary mejital powers, such as 
memory, we encounter the facts, then, of its easily observable 
and readily recognizable material, of the facile perceptibility 
of the elements in and for themselves. The difficulty of the 
problem comes in rationalizing the -ra-lue of each whole situa¬ 
tion, of the worth of the various elements and of the cut-out 
objects (the store of ideas) as possible solutions in the given 
situation—atid this Is apperception. 

Through its presentation of problems that are visual, non¬ 
language, ideational, pictorial, a representation of everyday 
scenes and activities, this test brings into play an important 
mental ability—whether specialized as being related to obser¬ 
vational and pictorial material or capable of wider interpreta¬ 
tion—an ability that wc would eagerly know more, about for 
many practical purposes. The reaction expressed by one 
well-known psycJiologist on first seeing the test, “Well, if 
I were hiring people to assist me, I think I should like this 
test to hire them by,” may be paralleled by many another 
opinion of like import from those who have been using this 
among other tests. Noting that the higher records on the test, 
we may take the perfect score, 100, for example, have-been 
done by only very occasional youngsters of high ability, as 
proved by other tests, and by some adults who have estab¬ 
lished reputations for achievement, and these records have 
been equalled very rarely indeed by others, for instance, by 
a domestic cook, we may look further and generally discover 
in these cases (as in the latter instance where this cook was 
found to be well known as having exceptionally good common 
sense and judgment) that there are obtainable evidences of 
the correlation of such a performance with otherwise known 
good mental capacities. The powers that this test uj some 
measure gauges are certainly those allied with better human 
achievement. 



THE CONSTRUCTION OF TESTS FOR THE DIS¬ 
COVERY OF VOCATIONAL FITNESS 


By Frank Watts, University of Manchester 


It will be agreed that the successful construction of tests for 
the discovery of vocational fitness must depend in the long 
run upon an accurate psychological analysis of the various 
occupations followed by men and women. Only when this 
has been accomplished in a sufficient number of cases will it 
be possible to foriiuilate general principles in accordance with 
which we may know how to proceed in given instances to 
frame reliable tests for ready use. The attempt to elucidate 
such general principles may at the moment appear to many 
to be premature, but it is difficult to spend much time in the 
work of trying out tests in industry without feeling that the 
fundamental assumptions underlying the different methods of 
test-construction call for careful examination. We cannot hope 
to proceed far in. practice with safety without guiding prin¬ 
ciples ; and it is with certain of the theoretical aspects of this 
subject, therefore, that I propose to deal in this paper. Occa¬ 
sional reviews of the work already done cannot but be helpful 
to those engaged in actual investigations. 

How may we classify the tests already in use? One broad 
method of classifying them would involve their division into 
analytic and synthetic tests, the former representing the 
method of investigating separately the various mental and 
physical factors which enter into the performance of a piece 
of work, while the latter type stands for the attempt to 
measure vocational aptitude as a unitary capacity. Synthetic 
tests may be further subdivided into the various sample tests 
such as (1) vocational miniature tests, oral trade tests, picture 
trade tests, written trade tests and performance trade tests; 
(2) empiric tests, which at present represent the application 
of the method of triaUand-error in vocational psychological 
psychology; and (3) analogous tests which, combining the 
advantages of the analytic and the sample tests, will, I ven¬ 
ture to believe, prove the only satisfactory means in the long 
run for diagnosing potential as distinct from actual voca¬ 
tional aptitude of a non-routine kind. Let me describe what 
I conceive to be the advantages and the disadvantages of each 
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type of test as far as experience permits me safely to do so. 
I shall venture to take a point of view which is slightly dif¬ 
ferent from that of other workers.’- 

The analytic test, as has been indicated already, attempts 
to isolate and measure separately in respect of individual ap¬ 
plicants for employment those physical and mental factors 
which are predominantly demanded in the given occupation. 
There are obvious limitations to the utility of this method. 
One could hardly employ it to take an extreme example from 
outside our subject, in determining- whether a man (or woman) 
were suitable for the life-occupation of husband (or wife). 
Firstly, it would be well-nigh impossible to analyse out into 
clearly distinct factors all the various mental capacities called 
for in the state of matrimony. Secondly, if such an analysis 
were achieved it would be practically useless to attempt to 
isolate each factor involved for separate investigation and 
measurement; for how could one be sure of dealing with any 
one quality with the certainty that it was completely detached 
from others intimately associated with it? Thirdly, even if 
these two insuperable difliculties were removed we should 
still need to know in what proportions the single elements 
entered into the composition of the complete capacity, and this 
raises an important problem which I have never seen faced 
by anyone who lias recommended or employed the analytic 
method of testing vocational fitness. This problem is one of 
deciding how to "weight" the scores for the various single 
capacities so that the total score is really a representative 
score. I have already indicated in another paper that by 
“ weighting " the scores for important capacities in a number 
of subjects, rankings may be obtained quite different from 
those obtained when weighting is neglected.^ Fourthly, to 
continue our objections, the analytic method assumes that a 
psychic whole is merely the sum of the factors into which it 
can be conveniently split up, and this assumption ought not 
to be accepted in the absence of proof. The belief which 
would seem to be justified is that personality is not thus arbi¬ 
trarily to be divided up into part capacities without loss. To 

^ Cf.- Essay by Cyril Burt in Lectutes on Industrial Administration, 
pp. 79-104. H. Hollingwortli, yocational Psychology, ch. v. B. Muscio, 
Lectures in Iruiustrial Psychology, pp. 119-152. 

2 See The Outlook for Vocational Psychology, Bril. Jour. Psych)., 
XI, 2. A simple method would be to allot more marks to some of the 
tests in any scries than to others. As a possible aid_ to an elucidation 
of the problem which would then arise of the relative importance of 
the various capacities entering- into a performance a hierarchy of our 
human capacities is appended. 
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use a homely illustration, an unanalysaltic factor of experi¬ 
ence may result in two women producing two entirely different 
cakes with similar ingredients mixed in the same propor¬ 
tions, the baking conditions being constant. 

Professor Seashore's patient analysis of the requirements 
of the singer into something like forty different qualities, 
though an ingenious piece of work from one point of view, 
would hardly seem, therefore, to be useful to the vocational 
psychologist in search of a test of singing ability. Separate 
investigations by scientific methods regarding the range of 
voice, the ability to sustain tones, the memory span, the deli¬ 
cacy of pitch discrimination, the association type, "mental 
plasticity,” creative imagination, and so on, would prove to 
be unnecessarily tedious and probably highly unsatisfactory 
in view of the difficulties alre^y indicated. 

Let us take two potential singers A and B who may have 
happened each to score a hundred marks in a series of tests 
applied in accordance with the analytic method. Unless they 
have made identical scores in the separate tests—which is 
unlikely—does it help us to say they have been " scientifically” 
proved to possess equal ability or promise? A has scored 
heavily in one direction because he possesses a magnificent 
natural voice, but B who lacks such an asset has made up 
for this deficiency by the possession of marked creative imag¬ 
ination and control of feeling. So that all we can gather 
from the elaborate tables of results would be, what we prob¬ 
ably knew already, that A excelled in one way and B in 
another. 

There seems to he justification, then, for suspecting that 
in all but the simplest cases the analytic method will probably 
prove worthless. It is where routine work is concerned and 
the chief capacities called for are no more than one or two 
of the sensory or motor functions which are almost mechan¬ 
ical and practically divorced from the higher forms of intelli¬ 
gence, that the analytic test may be useful, and useful here 
because the intellectual factor does not complicate significantly 
the various .capacities measured. But even then there may be 
dangers in ignoring in any series of tests the intellectual 
factor as we shall hope to show later.' 

The method of “ the empiric test ” is strongly recommended 
by Hollingworth (who, however, admits it to be a " rough 
provisional and unanatysed expedient”) as representing "the 
most promising experimental procedure for the immediate 
present and perhaps for some time to come.”® 

3 P. 119, op. cit, 
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It is a method which necessitates no preliminary psycho¬ 
logical analysis of tasks. The experimenter simply applies 
a number of miscellaneous standardised tests, e. g., the com- 
plcHon test, the amloffics test, the cancellation lest, etc., and 
notes how closely the scores obtained correspond with esti¬ 
mates of trade ability. Those tests which correlate highly 
with such trade estimates are then accepted as suitable for 
diagnosing capacity for the occupation under consideration, 

" Perhaps the most perfect example of this purely empirical 
procedure/^ writes HoIIingworth, " is the investigation which 
has jjow becji cojrducted for several years by Mrs, Woolley 
and her co-workers in Cincinnati. Children who leave the 
grades to enter directly into some sort of industrial occupa¬ 
tion, are exaiiiincd by a miscellaneous assortment of simple 
mental tests. These records are preserved and the subsequent 
successes or failures of the pupils in the various sorts of work 
undertaken by them in later life are as carefully recorded as 
possible. It is hoped that when a suHicient amount of material 
of this nature has been accumulated, the two sets of data may 
be compared and information thereby secured concerning the 
relation between ability in the tests and the types and degrees 
of industrial fitness.”* 

To argue anything of a general nature from this special 
application of the empiric method is to assume that the interests 
of boys and girls are either permanent or change in an orderly 
and predictable manner. But tests which interest the boy or 
girl while at school and tend therefore to call out a maximum 
of ability in their performance may cease to attract in later 
years; so that if applied later they must inevitably produce 
results which are not to be relied upon to the same extent as 
data for diagnosing vocational aptitude. 

But speaking generally, the empirit method is unsatisfactory 
because it is at best nothing more than a makeshift method 
for avoiding the difficulties of psychological trade analysis. 
To continue to employ this method without at the same time 
making an attempt to psychograph the work concerned is a 
procedure which will not be commended by any thinking per¬ 
son. The empiric method, more than any other, places us com¬ 
pletely at the mercy of sampling errors where our human ma¬ 
terial is concerned, and of the errors, too, of the trade expert 
upon whom we must rely for trade rankings of the individuals 
tested. One of the greatest troubles in vocational testing is to 
find foremen who can give unbiased judgments about the bare 
vocational aptitude of tlie workers under them! There is 

* P. 114, op. cit. 




244 


WATTS 


always the double tendency present, which few but the most 
highly trained observers can control, to pass a favorable judg¬ 
ment upon those whose temperaments “ fit in " readily with 
their own so as to make for a harmonious working relation¬ 
ship, and also to see specific aptitude in what Thorndike calls 
a "halo” of general ability, but never apart from it in its 
own shape and outline.* Thus in the vocational world the 
empiric method of test construction in effect, shows us the 
blind leading the blind. Only when we are still completely 
unsure of our vocational analysis should we be content to 
employ the empiric method of test construction, and even then 
not blindly but for the deliberate purpose of opening up a 
way to a further knowledge of the psychological require¬ 
ments of an occupation. 

The various types of sample tests which have been advo¬ 
cated indicate an attempt to move away from the confusion 
of theory created by the analysts and the empiricists. But we 
shall see that if the theorists have unduly neglected the prac¬ 
tical requirements of industrial tasks the practical men who 
have devised trade tests have equally neglected to consider 
the theoretical implications of their procedure. To take first 
the commonest form o£ the sample test which has been used, 
viz.i the trade performance test. Here we see the applicant 
for employment given an actual sample of the work which 
he maj' later be called upon to perform. His fitness or un¬ 
fitness is to be gauged from an inspection of the results. This 
is a method which, lends itself readily tor use in a large nnvn- 
ber of occupations; lor example, in the choice o£ typists, clerks, 
musicians, athletes, skilled artisans, etc. The principal con¬ 
ditions for its successful application would seem to be: (1) 
that, at least, a representative part of the work is suitable for 
performance as a test without serious modification and (2) 
that the results can be expressed quantitatively.® 

The performance test-method is not without its pitfalls. At 
first sight it may not seem to call for any great psychological 
insight and yet to proceed without regard for the influences 
and effects due to unfatniliarity with the test conditions, lack 

® la framing intelligence tests Binet solved this difficulty by con¬ 
structing his ichelle nietrique which provided him with an independent 
standard for individual measnretnents. The same principle must be 
applied to industry, and the writer is at present attempting to do this 
in the case of one trade. 

«In Dr. J. C, Chapman's book ou ” Trade Tests," (Hoit & Co,, New 
York, 1921), will be found standardized performance tests for car¬ 
penters, pipe fitters, sheet metal workers, electricians, machinists and 
mechanics, blacksmiths, stenographers and typists, chauffeurs and soon. 
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of practice, fatigue, the use of unstandardised samples and 
unstandardised instructions, nervousness, etc., all of which can 
only be negatived by tlm employment of scientific methods 
of procedure is to risk serious error. Moreover, we must 
know before wc can judge a sample piece of work what an 
average.performance is, and this will necessitate considerable 
research in every case. To be successful, therefore, the sample 
performance test must be applied under controlled conditions 
and the results inter]ireted in relation to known standards. An 
intimate acquaintance with the methods of experimental psy¬ 
chology will alone ensure that these conditions and standards 
have been obtained. 

The vocational miniature test is a special form of the sample 
test possessing its general disadvantages with particular ones 
of its own in addition. It calls upon tlie subjects of experi¬ 
ment to deal with small " toy " representations of the actual 
work to be done. 'Thus a switchboard, much reduced in. size, 
may be used for testing telephonists, or signalmen may be 
required to manipulate liny levers in response to demands 
for signals. It must be at once apparent that the number of 
tasks which can be reproduced in miniature is extremely 
small. But the method has been adversely criticised on account 
of its own intrinsic defects. Miinsterberg quite rightly says 
that "a reduced copy of an external apparatus may arouse 
ideas, feelings, and volitions, which have little in common with 
the processes of actual life.”* There Is no defence which can 
seriously be put up against this criticism. 

Moreover, as far as physical labor is concerned there is 
reason to believe tliat ability to perform the fine movements 
called for in working with small models is not at all indicative 
of ability to perform the larger movcmcjjts of the actual work 
which the small model is intended to represent, In the two 
cases not only will diflerciit muscular and nervous co-ordina¬ 
tions be necessary, but also different types of interest. Thus 
the watchmaker and the miniature-painter would usually be 
completely unsuited ” temperamentally,” as we say, as well as 
physically for employment respectively upon steam-turbines 
and motor-generators, or upon big poster work, In, other 
words, there is probably no ” general factor ” in motor ability. 

The oral trade test, the picture trade test in which a picture 
of a tool or piece of work is shown, and the written trade 
test are all types of sample test based on the questionnaire- 
method. Such tests obviously, are meant to elicit, and can 
elicit, nothing more than information. If these tests are used 

’ Piyehology and Industrial Efficiency, p. 67- 
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as supplementary to pertormance tests they may be employed 
to serve a useful purpose. But most of us liarbour the preju¬ 
dice that to know all about a game of skill or a trade is by 
no means proof that one is an expert in it, so that if such 
tests are used as substitutes for performance tests then the 
general question is raised as to the relation wliich exists be¬ 
tween skill and knowledge, and whether the latter can be 
accepted as adequately representative of the former. For the 
elucidation of this problem everything will depend on the type 
of question asked and the knowledge presupposed in the indi¬ 
vidual circumstances. In many cases it is, I believe, a mis¬ 
take to attempt to measure a bare ability independent of 
experience, because such experience may be the only proof of 
the presence of the interest upon which permanent efficiency 
depends. But it would seem on the whole that this type of 
test is one which can easily be coaclied for, if we are to take 
the American Army oral, picture, and written trade tests as 
truly typical of the method. 

The chief objection, however, which the vocational psy¬ 
chologist will be inclined to raise agaiii-st all sample tests, 
of no matter what kind, is that they may measure actual rather 
than potential capacity. They will not help us to select from 
among individuals without experience of a task those who 
would benefit most by training. The type of psychological 
test which is most urgently demanded—^the true vocational test, 
that is, is the test which can be applied to those about to enter 
an industry with, the idea ot gauging their probable fitness 
in advance, so allowing us to advise the nii.srit5 to choose 
another occupation before it is too late. The only satisfactory 
test which promises well from this point of view (as a means 
of choosing workers above the routine level) is the skilfully 
constructed analogous test. The fact that particular analogous 
tests have not been altogether successful in the past is no argu¬ 
ment against their real value. 

The analogous test method calls both for a tentative psycho¬ 
logical analysis of the work to be done and for the construc¬ 
tion of problems calling out as a combination the essential 
capacities and interests concerned, in much the same propor¬ 
tion as they are demanded in the actual tasks, but in such a 
manner as to allow potential capacity, when necessary, to com¬ 
pete on equal terms with capacity already fully developed. 
Really, therefore, it may often become in practice the sample 
method purged of its peculiar defects. It will be agreed that 
the work of constructing such tests is no simple matter, hut 
it will prove, I believe, the only real way of progress. 
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Miinsterbcrg's famous test for the discovery of car-driving 
aplilude was, up to a certain point, a test fulfilling these re¬ 
quirements. It was defective, not because of any inherent 
unsoundness in the analogous method, but because it issued 
from an incomplete analysis of car-driving aptitude. The 
method was employed by Munsterberg to replace the unsatis¬ 
factory method of vocational miniature which had .proved de¬ 
fective, “ Not the external siniilarily of die apparatus,” 
wrote Munsterlierg, ” but exclusively die inner similarity of 
the mental attitude,"" should be the chief characteristic of a 
test which is intended to reproduce the conditions of work in 
any occupation. Tlii.s inner mental attitude is usually so diffi¬ 
cult to analyse that it is not surprising that few excellent voca¬ 
tional tests have so far been constructed. Vocational psychog- 
raphy, that is to say, is still litle more than a mere phrase. 

What has been attenijited so far, however, will enable us, 
at least, to study our present position. One may say, to sum 
up the possibilities of the various types of test, that the various 
sample tests are useful for choosing skilled workers but use¬ 
less for selecting youths for apprenticeship, that empiric tests 
should only be used when other nicthod.s fail, that analytic 
tests may be used (subject to reservations) where routine work 
is concerned, but that where intelligence as well as specific 
aptitude is nece.s.sary the analogous test is needed, 

Most of the mistakes and shortcomings characteristic of 
our early attempts at vocational psychography may now be 
classified under the headings of errors of inclusion, errors of 
exclusion, and flio.se errors of proportion already spoken of 
in connection with analytic tests as responsible partly for their 
defects. 

To consider the errors of inclusion first Occupations may 
be grouped into two classes according as to whether intelli¬ 
gence is or is not the predominant factor demanded in them. 
In a large number of routine occupations the possession of 
more than an average amount of intelligence makes for dis¬ 
satisfaction, restlessness, and inefficiency. Yet, especially 
where the empiric method has been employed, intelligence has 
been a factor which unwittingly has been allowed to creep 
into the test performances designed to reveal aptitude for 
various types of routine work. Tests which arc virtually 
intelligence tests have been applied in various occupations where 
the workers have happened to be of low grade mental type, 
so that the sampling factor has ob.scurcd the significance of 
the results. But since diiTcrcnce.s of intelligence, even if small, 

®P, 08, op. cii. 



248 


WATTS 


Still exist and so are responsible for the test rankings, a close 
correspondence between test results and trade ability has been 
found. But this is not to say that universally wherever we 
have greater intelligence there we shall have also greater perma¬ 
nent aptitude for the routine work under consideration. For 
let us suppose that the Knox Cube Test, which has been used 
successfully to discover capacity among girls employed iiv label 
pasting, were to cc»nc lo the notice of a tyrant with wide 
powers, ruling a modern cominunity, who had no use lor 
teachers of psychology. Would he be right in acting on the 
assumption that if these persons endowed with marked intro¬ 
spective habits of mind were given the Knox Cube Test to 
perform then the most succes.sful would make, for more than 
a few hours, the best label pasters? Obviously not. 

Thus with every routine operation, tests will often work 
well only supposing that (1) they arc tests of aptitudes which 
are largely iudepeudent of intcUcctiial ability, and (2) that 
the sample from whom wc arc to make onr choice contains 
no individuals of more than average intelligence and initia¬ 
tive. These conditions were given when Mr. S. E. Thompson® 
carried out his reaction-time' experiments with 120 girls 
employed by him as bicycle-ball inspectors so that he was able 
to depend entirely on speedy reaction-time a.s the jno.st e.sscii- 
tial element making for success in tlreir work. Had the work 
involved a fair measure of intelligence, mere reaction-times 
would have been much less significant of capacity. As it was 
he was able to select 35 girls superior to the others in the essen¬ 
tial quality, and by a modification of the conditions of work 
(better wages, shorter work periods, holidays, etc,), was able to 
produce an output not less than tefore. 

To put the matter in another way, In many occupations 
it may be discovered that a specific aptitude or native interest 
plays a greater part in making for success than intelligence. 
In such a case we must beware of relying entirely on tests 
which are really tests of intelligence rather than of specific 
capacity. 

The errors of exclusion are usually due to the neglect of a 
definitely specific interest in a test-ai^peal. Thus, Miinster- 
berg's test for car-drivers was excellent in conception but 
intelligence was allowed to play too considerable a part, while 
the interest in driving real cars in real streets which alone will 
ensure permanent satisfaction and efficiency in the work did 
not enter into the test to any extent, Plad the test been one 
in which only those with the interests already referred tn, or 

®Sce F. W. Taylor; Scientifte 
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at least the capacity for developing them in the actual work, 
could have done well the College students who performed the 
test and excelled above the best drivers would have found their 
proper level/° 

The foregoing considerations must suggest to the reader 
how imperative it is that we should attempt to analyse out as 
completely as possible the various mental and physical factors 
which enter, or should enter, into the performance of the 
principal industrial tasks. Now the uncritical acceptance of 
text book classifications of the mental factors which may 
enter into the composition of vocational capacity will not help 
us very much. 

In reading works on the subject of vocational selection, 
one cannot fail to be struck by the fact that writers are apt 
to use many of the psychological terms for our various apti¬ 
tudes in such a way as to blind one to their frequent com¬ 
plexity. Thus, among supposed mental “ elements,” we find 
such things as tact, perseverance, attentiveness, reliability, cau¬ 
tion, accuracy, mental tempo, memoiy, industry, neatness, etc., 
and the impression conveyed is that there are definite unitary 
mental factors easily discoverable corresponding to these vague 
general term.s. The result of this use of general terms, how¬ 
ever, is frequently unfortunate. For example, when the 
peasant ploughs a clean straight furrow, or the seamstress 
sliows a beiutifully worked hem, or the typist displays one's 
correspondence with marked legibility, or the housewife main¬ 
tains a home in spick and span condition, we are apt to say 
and think that they all manifest in their own way a single 
indivisible quality called neatness. Such a way of thinking 
often deceives us, for these varied forms of neatness though 
conveniently summed up in this manner under a single name 
are by no means the same qualities psychologically. Only a 
crank would expect to discover the best ploughman or the 
best seamstress by means of neatness in a written test. Simi¬ 
larly, if it were agreed that a proof-reader needed to be gifted 
for detecting errors it would be absurd to test him by any 
kind of exercise except one dealing with printed matter. 

So when one comes to investigate the mental make-up of 
adult workers as it is expressed in any particular occupation, 
what is found is that the " elementary ” qualities popularly 
ascribed to such workers are by no means as simple and 
indivisible as is implied, We do not find as a result of actual 
experiments that the best proof-readers are always character¬ 
ised by the possession of a power of close attention applicable 

80 . op. at. 




250 


WATTS 


in many directions, that fitters or instrument-makers display 
a quick recognition of the significance of form (of no matter 
what kind), that telephonists develop a good all-round memory, 
or that street-car drivers exhibit a general ability to apprehend 
the relations, no matter what, existing between several things, 
no matter where. What we do find instead is that with the 
vast majority of adolescents and adulls each ability is more 
likely to be quite clearly specific and limited in scope. That 
is to say, a person may be a bad observer as regards the com¬ 
mon incidents of the streets, but a good observer of natural 
phenomena; a youth may have a bad memory for dates In 
history but a good memory for football fixtures; a man may 
have a remarkably effective power of paying close attention 
to the movements of machine parts but not to checking figures 
or letters which pass before him; one may be able to apprehend 
the relations existing between the many factors involved in a 
game if one is a spectator, but not if one is a player; a woman 
may exhibit a remarkably quick mental temf>o in clerical work, 
but a deplorably slow tempo in organising a home; and so on, 
Thus it will be clear that no ability can be wholly understood 
or profitably investigated apart from the living interest which 
energises it. 

The difficulty which will suggest itself to many who have 
thought about the part which any interest,,should play in a 
psychological test is that since most iiucre^ts. do not develop 
except through the assimilation of knowledge and skill, it is 
impossible to allow them to enter into the performance of a 
test without thereby placing their possessors at a great advan¬ 
tage over others equally capable of doing good work whose 
interests are not yet aroused. It may help to remove this diffi¬ 
culty if we distinguish between the capacity or skill which is 
determined largely by the existence of an interest or interests 
wnich any intelligent person may develop irrespective of his 
age, and that capacity or skill which is largely due to the devel¬ 
opment of a specific interest at an early age for the absence 
of which no amount of intelligence in later life will adequately 
compensate. Thus if one should be selecting men for re¬ 
sponsible open-air work in a distant colony it would probably 
be much more satisfactory to choose those whose interest in 
the colonies and in open-air life is of that deep-rooted type 
which appears early, becomes nourished and strengthened by 
tales of adventure and danger, and remains proof against the 
passage of tlie years. A question such as. “ Wlien did you first 
get to know about this kind of work?” will usually reveal 
the age and strength of the interest concerned. In many cases 
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where industrial efficiency depends upon interests developed 
early in life it will be found possible to construct " age scales ” 
in the Binet manner so that the extent of the progress made 
in the developing capacity and skill may together be esti¬ 
mated. But even where occupations demand the functioning 
of interests which normally do not develop early it will still 
be necessary to appeal to them in our tests since intelligence 
tests alone will not suffice. We must still contrive to con¬ 
struct tests which will allow the same interest or interests to 
operate in the test as in the actual work, and the consequence 
will then be that those individuals possessing such an interest 
or interests but lacking " all-round ” intellectual ability, can, 
compete on equal terms with those intelligent persons who are 
able to make good at most occupations interesting to the aver¬ 
age man or woman. 
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been no general intermingling of blood. Doubtless the Dravi- 
dian tribes were of different degrees of civilization. The most 
backward of them, the jungle dwellers,,of whom there are 
living examples in many parts of India today, are the pro¬ 
genitors of the outcastes of the present day. So far as inter¬ 
marriage occurred at all, it must have been with the more 
civilized of the Dravidians. 

That there are marked physical differences between most 
of the Brahmans of South India and the typical outcaste living 
in the same village is evident from a casual comparison of 
their color and features. It may also be shown by a com¬ 
parison of their cranial and nasal indices. Investigations along 
this line are to be found in the work by Thurston referred to 
above, Whether there are also marked differences in men¬ 
tality that can not be accounted for by differences of environ¬ 
ment in its broadest aspect is a question of much interest. 

The choice of the kind of test to be used naturally fell upon 
one of the scries of performance tests described in "A Scale 
of Performance Tests," by Plntner and Paterson. The one 
that seemed to be the most generally useful was the Goddard 
Form Board. The Binet system was out of the question, since 
it has not been adapted for use in any of the numerous 
languages of India, This form of test depends sp much on 
language responses that it would be hopeless to attempt to 
get reliable results by means of it before the questions had 
been carefully translated into the. language of the subjects 
whom it was proposed to test, and proved by actual use. This 
would have been doubly difficult in the case of the children 
whom the writer tested, as they belonged to two different 
language groups. The use of performance tests avoids this 
difficulty. The Goddard Form Board was chosen as the most 
practicable test with which to begin the series because it has 
been so favorably spoken of by eminent psychologists in 
America, It also seemed to the writer to require the exercise 
of several kinds of mental ability. Not one of the more than 
700 boys and girls tested had ever seen a form board, it is safe 
to assert- Few, if any, of them in all probability had ever 
handled blocks of wood or other material of different shapes, 
much less tried to fit them into holes of corresponding shapes. 
To be confronted with a board full of holes and a lot of 
blocks, and to be told to put the blocks into the holes as 
quickly as possible, was a new situation for each of those 
children. Thus it was well adapted to test their intelligence. 
At the same time there was nothing unreasonable in the test, 
so perfectly simple is it. 
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The method of giving the test was in general that described 
in the book by Pintner and Paterson already referred to. The 
board with the blocks in their respective holes was placed on 
a table or bench before the subject, who was told to watch 
closely what the examiner did. The latter then took the 
blocks out of the holes one by one, and'laid them in the 
standard order in three rows by the side-'df the board at the 
subject’s right hand. The subject was then told to put the 
blocks back in their right places, A native teacher was always 
present to make sure that the examiner's words were under¬ 
stood. In case of doubt he would repeat the command. Three 
trials were given, and the time and errors (if any) were 
recorded. The time of the fastest performance was regarded 
as the index of the subjects psycho-motor ability. In practice 
it was found best not to ask for speed at the first trial, as 
that tended to confuse him, and sometimes resulted in wild 
dashes at the board with little effort to avoid errors. A 
correct performance was the first thing aimed at. Before the 
second trial, however, the subject was told to put the blocks 
in as quickly as possible. Before the third he was urged to 
his utmost effort for greater speed. 

The subjects examined were of both sexes. With a very 
few exceptions all were attending schools of average excel- 
.lence. All were town-bred. Thus in the two groups respec¬ 
tively the home life and advantages, were practically the same. 

The tests, with few exceptions, were given in the afternoon 
and generally in an unoccupied room or part of a hall in the 
school buildings, so that both subject and examiner might be 
as free as possible from distractions of any kind. Avoidance 
of distracting sounds was in many places impossible, as can 
be readily understood by any one who has visited even the 
best of schools in India, where the hot climate requires that 
doors and windows be kept wide open. As the pupils are 
used to these conditions, they need not be regarded as invali¬ 
dating the tests. 

Aside from the effort to secure an .equal number of Brah¬ 
man and Panchama children as subjects, no attempt at selec¬ 
tion among the children of the schools where the tests took 
place was made. If this was done surreptitiously by teachers 
in any of the schools, it would tend to weed out the dullest 
ones, since the teachers would wish to have their pupils make 
as creditable a showing as possible. Tliis would of course 
result in a higher average performance. 

No performance time longer than 81 seconds was included 
in calculating the medians, in order to exclude records that 
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suggested decided mental backwardness, and to arrive at 
norms showing the average ability of ordinary school-going 
children in South India. Not more than one or two records 
were thus rejected in any one age group. These were only 
in the younger ages. 
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TABLE I—Panchamas 



Total. 9 16 36 ^ 39 33 30 37 39 35 22 

75 Percentile. 37 32 33 28 24 23 22 19 18 18 18 

Median. 42 40 37 31 ^ 26 25 23 20 20 20 

25 Percentile. 49 45 43 37 33 30 23 27 22 23 22 

Quartile. 6 6.5 5 4.5 4.5 3.5 3 4 2 2.5 2 
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36 
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22 

75 Percentile. 
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19 

17 
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Tables are appended showing in detail the results of the 
tests. 

For convenience of comparison a graph also has been pre¬ 
pared showing the median times of the Panchamas and Brah¬ 
mans tested by the writer, to which has been added a line 
showing the median times of American children of correspond¬ 
ing ages according to Sylvester's tests. It will be noted that 
the Panchamas are from one to four seconds slower than the 
Brahmans at most ages. The average difference is about 
two and one-half seconds. Perhaps this can be accounted for 
by the great difference in the social and educational oppor¬ 
tunities enjoyed by the two groups in the past, and by the 
difference in their environment, which any one acquainted with 
conditions in India can not fail to have observed. 

When we compare the medians of the Brahman children 
with those of the American group, we find an even more 
striking difference. At the age of four the American are 
much slower than the Brahman children, the median times 
of the two groups being 46 and 41 seconds. At age five, how¬ 
ever, the American children have caught up with the Brah¬ 
mans, the medians for each group being 37. At six years 
the median time of the American group is 26 seconds, or seven 
seconds less than that of the Brahmans. In other words, 
between the ages of four and six the American children have 
increased the speed of their performance' 20 seconds, while 
the Brahmans have increased theirs only eight, From this point 
onwards the Americans maintain their lead, and are from 
five to eight seconds faster at every succeeding age. The 
average difference is about six and one-third seconds. 

The task of assigning causes for this very considerable 
difference is too large and complicated to attempt fully here. 
One fact is patent, viz., that the advance made by American 
children between the ages of four and six is much more rapid 
than that made by even the quickest group of Indian children 
of corresponding ages. It is generally accepted that children 
in the tropics mature earlier than in a colder climate. Pre¬ 
sumptive evidence in support of this is found in the fact that 
the " age of consent,” i. e., the age at which a girl may be 
legally married is fixed by law in India at twelve years, So 
it is not surprising that the Indian children at age four should 
be capable of a faster performance than the American four- 
year-olds. 

Again, the gain of 20 seconds in speed of performance 
made in two years by the American children, as compared 
with a gain of only eight seconds made in tlie same period 
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by the Brahman group, may be accounted for at least in part 
by the better system and methods of education prevailing in 
the United States. The kindergarten age lies between four 
and six. India has not begun to approach America in the 
thoroughness with which the kindergarten has been developed, 
nor in the extent to which it has been employed, 

Whether these considerations account fully for the (hffer- 
ences noted above, or whether the large difference in the 
median times of the American and the Brahman groups from 
six to fourteen years of age indicates a fundamental difference 
in the mentality of the two groupsj is a question that need 
not be discussed here. 

One or two other facts of interest are to be noted. First, 
there is a check at age seven in the case of the Brahmans. 
They make no increase in speed from age seven to eight, the 
median times for the two ages being the same. Another 
occurs at age eleven. There is a similar check in the case of 
the Parlchamas at age eight. 

Again, the Panchamas show no increase in the speed of their 
performance after the age of twelve. So far as the form 
board shows, they have attained their full mental growth at 
this age. This, as of course all other inferences based on a 
single test, would need to be confirmed by other tests. 

The quickest time made by any Indian child was 14 seconds, 
and was made by only three, viz., one Brahman of 12, one of 
13, and one Panchama of 14 years. The fastest time made by 
any American child, as recorded by Sylvester, is nine seconds, 
and was made by children of 11,13 and 14 years. 



A STATISTICAL METHOD FOR INCOMPLETE 
ORDER OF MERIT RATINGS 


By M. J. Ream, Carnegie Institute of Technology 


Rating scales are being used in an increasing number of 
industrial fields. Tlie diverse situations in which ratings of 
employees are now being attempted have made necessary cer¬ 
tain adaptations of the standard rating procedure. When a 
number of judges rate a group of individuals by placing them 
in an order of merit from the best to the poorest, direct 
comparisons are possible only in case each judge has rated 
the entire group. But if for some reason, such as lack of 
acquaintance, some of the judges were able to place in rank 
order only a portion of the group, the resulting rank positions 
would not be comparable. A method has been devised for 
combining such incomplete order of merit ratings in which the 
judges rate unequal numbers of individuals. 

A case in point is the W. T. Grant Company which operates 
a chain of retail stores throughout the East. This company 
wished to get estimates of the comparative efficiency of its 
store managers, but because of their scattered geographical 
locations, no one judge could know all the men to be rated. 
Accordingly at a company convention, instructions for rating 
were given the judges as follows: 

“ Sheet I attached is a list of all the store managers of the 
company. First, go through the list and check the names of 
those with whom you have worked at least six months. Check 
any others with whom you feel sufficiently well acquainted 
to judge of their executive abilities. Copy the list of checked 
names on Sheet IL 

“ On each remaining sheet, a specific trait is listed and ex¬ 
plained. Under this heading write the names you have checked 
according to merit in this particular trait. Put the name of 
the best man at the top and the poorest at the bottom. 

The results of this rating contained lists with as many as 
fifteen men ranked and lists with as few as three ranked. The 
problem was to combine the estimates of the judges to get 
the most probable order of merit In each trait. 

A survey of the literature on the subject gave but one sug¬ 
gestion, an article by Professor E. L. Thorndike.^ 

^Thorndike, E. L, The tccliJiique of combining incomplete judg¬ 
ments of the relative positions ol n facts made by n judges, Journal 
of Philosol>hy, Psychology mid Scientific Methods, 1916, 13, 197-204. 
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He suggests that the first step is to get a rough approximation 
to the true order by mere inspection. The next step is to 
compare each individual with his neighbor in terms of the 
percentage of judges (using only those who rated the two 
individuals in question], who rated the former individual as 
lower numbered than the latter. Professor Thorndike gives 
a table in which any given division of opinion among 2, 3, 4, 

5, 6j.15 judges may be expressed in terms of the median 

deviation. This process of comparison is continued with two 
or three next neighbors, and the several values determined 
from the table are averaged. Changes in position are made 
on a basis of these comparisons. 

This method was tried with the Grant Company data but 
was far from satisfactory. Most laborious was the computa¬ 
tion of the average differences in terms of the median deviation, 
from direct comparisons, next neighbor and second and third 
neighbor comparisons, and from indirect comparisons. After 
an average was obtained, a change of position was made on 
the basis of it, and new computations were necessary to justify 
the new position. 

Furthermore, it was possible to get contradictory values 
by the method of indirect comparisons for individuals who 
were not directly compared by any judge. The indirect com¬ 
parisons in addition to being laborious became confusing. 
Thorndike in his closing paragraph admits the possibility of 

ambiguity, ".The resulting' order should not without 

some consideration be used instead of the order derived from 
comparison with next neighbors only; for the next neighbor 
comparison, though not utilizing the data fully, is simple and 
unambiguous in its meaning.” 

To avoid tliese difficulties, a new method, or rather a modifi¬ 
cation of this method was devised and is presented as follows: 

(1) For each rank-position on a list containing a given num¬ 
ber of names, numerical values are assigned in terms of the 
standard deviation, assuming a normal distribution in each 
list of men rated. The values for any given rank-position 
are shown in Table I. For example, on a list containing 
six names, position one is assigned -j-1.49, position two -}-.68, 
position three +.22, position four —.22, position five —.68, 
and position six —1.49. These values were computed from 
Thorndike's Mental and Social Measurements, Table 22. The 
value 1.49 assigned to the first position on a list of six names 
represents the average amount in terms of o-of the upper 16.6% 
in the group, counted in from the extreme toward the average; 
the value .68 assigned to position two represents the average 
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amount in terms of a of the next highest 16.6% in the group. 
Values are similarly computed for other rank-positions. When 
a rank-position is reached which brings the percentage below 
the average, the a value to be assigned becomes negative. 

It is obvious that an individual ranked at the bottom of a list 
of three names should be assigned a different value from the 
individual who is ranked at the bottom of a list of twelve. 
Table II shows a sample method of tabulating the rating, 
in this case ten judges on thirteen individuals. 

(2) On the basis of these assigned values, an algebraic 
average is found for each individual, and from these averages 
a new ranking is made with the individual with the highest 
average in position one, and the individual with the lowest 
average in position N. 

(3) The verification and correction for this new order of 
merit is accomplished by the method of simple next neighbor 
comparisons only. By referring to Table II, the various rank¬ 
ings for any pair of individuals can be quickly obtained. For 
example, Subjects D and A have been given rank positions 
9 and 10 respectively, on the basis of their numerical averages, 
In this case the two individuals appeared together on the lists 
of four judges. If Subject D was ranked higher than Subject 
A in three of the four lists, Subject D would be placed above 
regardless of the difference in numerical values previously 
assigned, which in this case was small. Subject D would 
then be compared with the next neighbor above until he proved 
to be a loser; similarly Subject A would be pushed down until 
he proved to be a winner. The simple direct comparison 
was made the crucial test in any change of position, In cases 
where the wins and losses were a tie, or in cases where no 
comparison of the two individuals was made, the numerical 
averages obtained in the second step above, were the criteria 
for determining relative positions. 

It was found that at the upper and lower extremes of the 
order of merit, obtained in (2), practically no shifts were 
necessary as a result of the next-neighbor comparisons in (3), 
but frequent shifts were needed in the middle of the scale. 
However, the rank method of rating is generally considered 
less reliable in the middle of the scale than at the upper and 
lower ends. 

The metliod just described proved to be much less laborious, 
and ambiguities and ties could be settled by reference to an 
independent miinerirnl value. In the case of the Grant Com¬ 
pany, the results of the rating differentiated quite strikingly 
the exceptionally good from the notoriously inefficient store 
manager. 
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the intelligence of CHINESE CHILDREN IN 
SAN FRANCISCO AND VICINITY 

By Kwok Tsven Yeung, Stanford University^ 

The Problem 

The specific purposes o£ this investigation are: 

1. To discover the general intelligence level of Chinese 
children in the vicinity of San Francisco by means of the 
Stanford Revision of the Binct tests; 

2. To reveal sex differences, if such exist; 

3. To compare the intelligence ratings of Chinese and Amer¬ 
ican children of similar social status. 

The Method 'of the Investigation 

The Stanford Revision of the Binet scale was given to 109 
Chinese children during, the spring of 1921. These children 
ranged in age from live to fourteen years and were all Amer¬ 
ican born. Of the total number, 62 were boys and 47 were 
girls. In order to .secure uiiselected groups, all of the Chinese 
children horn In San Francisco or -vicinity of the ages nine 
to ten and twelve to thirteen were tested, This first group 
numbered 49, tlie second group 33, the remaining 27 being 
of variou.s ages from five to fourteen. Most of these children 
came from parents of the laboring and farming classes, chiefly 
immigrants from the region about the city of Canton. The 
parents had probably received education in China approxi¬ 
mately equal to tliat secured by the typical village class of 
Chinese people. The present economic and social environment 
of the groups from which these Chinese children came probably 
resembles Cliine.se conditions much more closely than American 
life in the vicinity of San Francisco. The Chinese tongue, 
customs, beliefs, and manner of' worship are all retained, 
They live in their own exclusive settlement, although the chil¬ 
dren attend the public schools and receive the same instruc¬ 
tion as do the white children. The Chinese children master the 
English language readily. 

In using the Bluet tests, the vocabulary tests were omitted 
as unfair to the Chinese children, thus necessitating a small 
change in the scoring of the tests. Credit for each test passed 
was given as 2,4 months for the ages at which there are 

1 Tlie writer i.s greatly indebted to Mr. G. M- Rudi, research assist¬ 
ant in education, Stanford University, for assistance in preparing this 
manuscript for the press. 
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six tests in the scale, and 3.4 months for each test at the ages 
having- ei^ht tests. Other than this change, the procedure 
was exactly that of the author of the tests. 

In addition to the tests of intelligence, ratings of school 
work estimated on the seven-point scale were obtained from 
the teachers. The teachers, of course, were not given the 
test scores until after the ratings had been completed. The 
coefficient of correlation between tests and ratings was obtained 
by the Pearson product-moment formula. The Pearson co¬ 
efficient of variability was also used in treating the data for 

Ths ResuUs 


TABLE I 

The Distribution o? the Intelligence Quotients op the 109 Chinese 
Children op Ages 5 to 14 Yeahs 


IQ 

Numbers 

Percent 

66-75. 

. 5 

4.6 

76-65. 

. 20 

18.3 

86-95.. 

.. 26 

23,8 

96-105.. 

. 38 

34.8 

106-115. 

. 13 

11,9 

116-125. 

. 3 

2,8 

126-135. 

. 3 

2.8 

136-145. 

. 1 

0.9 

Total. 

109 



The median tails at 96.9, or approxirnately 97, and the empirical mode 
•within the internal 96-105. 


TABLE II 


A Comparison op the I Q'a of the Chinese Children and the 905 Un¬ 
selected Children Studied by Terman’ 


Sfr^S.. 

66-75,. 

76-85,. 

86-95,, 

96-105. 

106-115. 

116-125, 

126-135, 

136-145, 


Chinese 

American 

Children 

Children 

0.0 

0.33 

4.6 

2.3 

18.3 

8.6 

23,8 

20.1 

34,8 

33.9 

11,9 

23.1 

2.8 

9.0 

2.6 

2.3 

0,9 

0.55 


The median for the unselected American group is 99 in comparison with 
97 for the Chinese children studied. This difference as well as the some- 
•what more restricted range of inteiligence quotients of the Chinese group 
cannot be held to be very rignilicaTit when the smaller numbers of the 
Chinese children are taken into account. The possible difference in the 
amount of selection represented in the two racial groups should also be 
called to attention in arriving at conclusions from the data presented here. 

®Terman, L. M.The Measurement of Intelligence, page 40, 




















INTELLIGENCE OF CHINESE CHILDREN 


Graph I shows the data of Table 11 in graphic form. 
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The following table shows the results of Binet tests given 
to several racial groups in the vicinity of Stanford University.® 
Except for the Chinese groups, the children were all in kinder¬ 
gartens, who, as stated by Termaii, usually show a higher score 
than do children of higher ages. 


TABLE Iir 


Race or Nalbnalily 

Numbers 

Median 

Spanish. 

37 

78 

Portuguese. 

23 

84 

Italian..... 

25 

84 

Chinese. 

.... 109 

97 

North Euroi>ean. 

14 

105 

American. 

49 

106 


^Unpublished daU, 
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It will be seen that the Chinese rank higher than the South 
Europeans and below the North Europeans and Americans. 
However, the Chinese children are older and such compari¬ 
sons are probably not as unfa-vorable to the Chinese in com¬ 
parison with the American children as seems to be the case 
at first g’lance. 

In Table IV which follows, the distributions of the I Q’s iu 
percentages are given for the two unselectcd groups of Chinese 
children, i.e., the 9-10 year olds and the 12-13 years olds, in 
comparison with Terman's group of 90S unselected American 
children. 

TABLE IV 

The Distributions op the I Q in Percentages por the two Unselected 
Chinese Groups in Comparison with Unselected American 
Children i 


Terman’s 905 Unselected Unselectcd 

Unselect^ Group of 49 Group of 33 
I Q American 9-10 Yr. Old 12-13 Yr. Old 

Children Chinese Chinese 

Children Children 

% % % 

56-65. .. 0.33 0.0 0.0 

66-75... 2.3 4.1 6,1 

76-85. 8.6 12.2 21.0 

86-95 . 20.1 26,5 21.0 

96-105.. 33.9 51.0 30.3 

106-115. 23,1 6,1 6,1 

116-125. 9.0 0.0 3.0 

126-135. 2,3 0,0 9,0 

136-145. 0,55 0.0 3,0 


The median I Q for the American, Chinese 9-10 year old, 
and Chinese 12-13 year old children falls, respectively, at 
99.0, 97.4, and 96.0. 

The following Table (V) shows the same two Chinese 
groups in comparison with unselected American groups of the 
same chronological ages. 

The distributions for the Chinese children reveal tendencies 
for the I Q’s to pile up at the average interval 96-105, and 
to thin out at the upper ranges, in comparison with American 
children of the same ages. The differences are not strikingly 
large and the two factors of selection and language familiarity 
should again he called to attention in interpreting the results. 
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TABLE V 

Comparisons op Unselected Chinese and American Children of Ages 
9-10 AND 13-13 * 


Ages Nine to Ages Twelve to 

Ten Years Thirteen Years 


IQ 

American 

Chinese 

American 

Chinese 

66-75. 

% 

. 2.0 

% 

4.1 

% 

5.0 

% 

6 1 

76-85. 

. 12.0 

12.2 

15,0 

21.0 

86-95. 

. 21.0 

26.0 

20,0 

21.0 

96-105. 

. 38.0 

51.0 

2B.0 

30.3 

106-115. 

. 6.0 

6.2 

19,5 

6 1 

116-125. 

. 1.0 

0.0 

11,0 

3.0 

126-135. 

. 1.0 

0.0 

8.0 

9,0 

136-145. 

. 0.0 

0.0 

0.0 

3,0 


Sex Differences 

Table VI presents the data on sex differences ior the total 
number of Chinese children tested. 


TABLE VI 

Comparisons of the Sex Differences in the 109 Chinese Children 
Tested, in Whole Numbers and percentages 


Boys Girh 

IQ Numbers Per Cent. Numbers Per Cent. 

56-65. 0 0.0 0 0.0 

66-75. 4 6.4 1 2.1 

76-85. 15 24.2 6 10.6 

86-95. 16 25.8 10 21.3 

96-105. 16 25.8 21 44.7 

106-115. 7 11.4 6 12,7 

116-125. I 1.6 2 4,2 

126-135 . 3 4,8 1 2,2 

136-145. 0 0.0 1 2,2 

Totals. 62 47 


The sex differences are in favor of the girls, the medians 
being 93.5 for the boys and 99.9 for the girls. The distribu¬ 
tion of the 1 Q’s for the girls approaches the normal distribu¬ 
tion much more closely than that for the hoys, which is skewed 
downwards, particnlarily in the 76-85 interval. The extremes 
of the distributions for the two sexes are not strikingly dis¬ 
similar. The ratio between the coefficients of variability 
(Pearson) for the girls and boys is 0.63. The girls, then, are 
considerably less variable. 

*Data on American children from Termau: Stanlord Revision and 
Exlensioii of llie Binel-Simon Scale, pages 35, 37. 
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Teachers* Ratings 

In order to make comparisons between the quality of school 
work and intelligence, ratings were secured from the teachers 
for the former on the basis of the 7-point scale. These ratings 
were correlated against the 1 Q's, giving a Pearson coefficient 
of 0.52 ± .048. The teachers’ estimates correlated with school 
work (marks) 0.46 ± .060. These values are about the 
usual ones obtained by many investigators following the same 
method, 

behoof Progress 

A few facts concerning age-grade distributions of the Chi¬ 
nese children are of interest. The 109 pupils were distributed 
from the first through the eighth grade. Using the standard 
of ages 6 and 7 being normal for the first grade, ages 7 and 
8 for the second grade, etc., it will be noted from the table 
which follows (Table VTI) that the amount of retardation 
is greater for the Chinese than for the American children, 
although, with respect to acceleration the comparisons are 
more favorable to the Chinese. Table'Vlll gives similar 
facts when the age-grade classification is m^de upon the basis 
of the mental ages. The coefficient between C. A. and grade 
reached in school is 0.84 ± .028, and for M. A. and grade, 
0.B8 ± .015. 


TABLE VII 

Acceleration AJ>n) Retardation for the Chinese and American Groups 
Upon the Basis op Chronological Age in Percentages 


Accelerated 
One year.., 
Two years.. 
Three years 

Total.. 

Normal,.,. 

Retarded 
One year... 
Two years.. 
Three years 
Four years. 

Total,, 


Chinese American 


16.5 

14,3 

3,6 

1.4 

0.9 

0.1 

21.0 

IB.8 

25;0 

44.3 

38.6 

27,9 

12.8 

8.8 

1.8 

2,4 

0.9 

0.6 

53.0 

39.7 
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Acceleration and Retardation for the Chinese and American 
Groups Upon the Basis of Mental Age in Percentages 

Chinese American 

Accelerated 

One year.... 23,& 15,6 

Two years. 3,6 3.2 

Three veara. Q ^ 0 A. 

Four years. 


. 0.9 

0.1 

Total. 


. 29.2 

19.3 

Normal. 


. 44,9 

40,6 

Retarded 




One year. 


. 19,2 

27,2 

Two years.. 


. 5,5 

10,2 

Three years.. 


. 09 

1,9 

Four years. 



0.5 

Total. 


. 25,6 

39,6 


Inspection of the distribution tables for age and grade will 
show that by the usual chronological age-grade classification, 
there is somewhat more acceleration and considerably more 
retardation among the Chinese. As would logically follow, 
when mental age is used, there is greater retardation for the 
American children. In other words, upon a mental age-grade 
basis the distribution of the Chinese children follows very 
much more closely the theoretically just basis than with the 
Americans. The excessive retardation of the Chinese chil¬ 
dren by the usual standards is very likely due to forced reten¬ 
tion of children in grades below those indicated by the mental 
ages because of unfamiliarity with the English language. 

Occupational Status 

The occupations of the fathers of the Chinese subjects 
were obtained and classified upon the 5-fold basis recommended 
by Taussig. Upon this basis, the great majority of the Chi¬ 
nese children came from parents of classes 3, 4, and 5. Laun¬ 
dry workers and ranchers were most frequent. As has been 
repeatedly found with American children there is considerable 
correlation between the-1 Q and social status, this for the 
Chinese being 0,49 ± .049, The data indicate that the co¬ 
efficient of correlation is lowered because large numbers of the 
Chinese children test in intelligence above their social and 
economic status. 
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Conclusions 

1. No striking differences in the intelligence of Chinese and 
American children are indicated by the results of this investi¬ 
gation. The Chinese children tested at about the level of 
Americans and North Europeans and markedly above South 
Europeans. The median I Q for the Chinese group was 97 
in comparison with 99 as found by Tennaii for the 905 un¬ 
selected American children studied. 

2. Sex differences may be indicated by the data, although 
the numbers are entirely too small for generalizations. The 
median I Q for the girls was found to be 99.9 in comparison 
with 93.5 for boys. 

3. Girls were only .63 as variable, according to the Pearson 
coefficient of variability. 

4. Retardation is more frequent among the Chinese pupils 
than the American, although the Chinese are more perfectly 
classified in school grade with reference to mental ability than 
are the American pupils. 

5. The Chinese of the vicinity of San Francisco belong 
chiefly to the lower levels of occupational status although there 
is a greater observable tendency for mental level to range 
above economic and social classifleation. 



METHODS FOR THE SELECTION OF COMPTOM¬ 
ETER OPERATORS AND STENOGRAPHERS 


By M. A, Bills, Carnegie Inslitute of Technology 
Communicated by C. S. Yoakum 


This study was made to determine if certain tests of the 
Bureau of Personnel Research of Carnegie Institute of Tech¬ 
nology would serve first, as a basis for the selection of appli¬ 
cants for courses in stenography and comptometer operation 
in a technical night school; and second, to determine if from 
a group of applicants it was possible to select successful comp¬ 
tometer and stenographic operators without an extended try¬ 
out. That is, the first purpose demanded that failures be 
eliminated and the second that sure successes be selected, 


Both purposes have been accomplished and the tests are 
to be used next fall as entrance requirements for the technical 
school, and as soon as employment is resumed^ by the firm 
interested, as guidance in hiring comptometer and stenographic 
operators. 

Both because of the problem presented and because of the 
methods of attack, which differ from those previously used, 
the study seems of special interest. The correlation between 
efficiency in the tests and efficiency in work has been the prime 
consideration in former studies.* In this study, because of 
the nature of the problem, correlations became merely a by¬ 
product, and critical scores the fundamental consideration. 
Also, a battery of tests has been used rather than a single 
test, with the idea in mind, that the more measures we could 
get of a person, the higher would be our ratio of success in 
selecting promising applicants. 

The technical night school where the tests were given was 
in close connection with a large manufacturing firm and prac¬ 
tically all of the teachers held positions in the firm and were 
therefore well able to judge the quality of wodc that would 
be acceptable in the business world. The ages of the students 
ranged from 16 to over 30. Practically- every nationality was 


1 On account of the business depression, the firm is doing practicaily 
no employing at the present time. 

2 A Standardized Test for Office Derks—L. L, Thurstone, Journal 
of Applied Psychologyi 1919, 3,—^pp. 248-251, 

The Value of Mental Tests for Office Clerks—M, J. Ream—To 
appear soon in Factory, 
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represented and all classes of home conditions. All students 
understood English. 

Three tests were given to the entire school (139 cases). The 
tests were: 

1. A general intelligence test, designated in this article as 
Test VI. 

2. A test devised to show special aptitude in stenography 
and typewriting, designated in this article as Test VIII. This 
test consists of five parts. 

3. The Will-Temperament test, designated in this article 
as Test IX adapted from Downey's test and so revised that it 
can be used as a group test. This test has ten parts. 

The criteria used were the failures and successes in the 
different classes. The teachers were asked not only to grade 
the student, but to indicate the line of work for which they 
considered her best adapted. A person was considered a fail¬ 
ure when her teacher did not recommend that she continue 
work in her course or enter an advanced course. A suc¬ 
cessful student was one that was recommended to continue 
her work, For example, if the teacher of stenography recom¬ 
mended that a student take up typing only, that student was 
considered a failure. If the teacher in typing recommended 
that a student continue in typing or take up stenography, that 
student was considered a success, while she was considered 
a failure if clerical or messenger work was recommended. 

Of those tested B4 were in the course in stenography and 
35 were in the course in comptometry. The remainder were 
in a preparatory course and will not he considered. Of the 
stenographers, 80 of the 84 took the entire series of tests 
and will be considered throughout the discussion, The other 
four have been included in the discussion of the tests which 
they took. Of the comptometer operators, the entire 35 took 
all three tests. Of the 84 stenographers, 26 were rated as 
failures. Of the 35 comptometer operators, 14 were rated 
as failures. 

The tests that we found to be most useful in eliminating 
failures and picking successes were Test VI, Parts 1 and 5 
of Test VIII and Parts 2, 3, and 10® of Test IX. As a whole 
it was found that Test VI (general intelligence), and Test 
IX (will-temperament) were the most successful in eliminating 
failures and that Test VIII (special ability) was the most 
efficient in selecting stenographers who were certain to be 
successful. 

® These correspond to the parts of the will-profile that Miss Downey 
has tailed motor vivhibitroa, speed oi decision and perseveiance, 
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Following are the results for stenographers in detail. We 
first attempted to eliminate failures. Our method can best 
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be illustrated by charts. In Chart I we have plotted .ores 
made in Test VI against the scores made in Test Dv, Part 
10. We have indicated in the chart the successes and iailures 
(O standing for successes—standing for failures). Each 
X and each O stands for a person; each person has also been 
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numbered. The numbers below 63 represent Juniors and the 
numbers 63 and above represent Seniors. It will be seen that 50 
seems to be a critical score in Test VI. If we had refused 
admittance to all scoring below this point we would have 
eliminated 11 failures and only 1 success.'* If we continue the 
elimination on the basis of a critical score of 60 in Part 10, 
Test IX, we eliminate 3 more failures and no successes. This 
makes a total of 14 failures eliminated out of the 26, and 
only 1 success. The critical scores are indicated by double 
lines on the charts. Now if we turn to Chart II, where we 
have plotted Part 3 of Test IX against Part 2, Test IX, we 
find that the combination of a score above 50® in Part 2 
and below 20 in Part 3 indicates certain failure. This com¬ 
bination would eliminate 7 out of the 26 failures. The persons 
have been numbered the same as in Chart I. Comparing the 
two charts, we seG that 5 of the 7 have already been elim¬ 
inated with Test VI, so that, considering the two charts, we 
find that we can eliminate 16 out of the 26 failures in 
stenography. 

Putting this into a four fold table, we have: 


Failed in tests and failed in course. 16 cases 

Failed in tests and succeeded in course.. 10 " 

Succeeded In tests and succeeded in course.... 56 " 

Succeeded in tests and failed in course.1 *' 

Total .... 83 " 


This means that 86% were correctly placed by preliminary 
examination. It is also important to note in this connection 
that no person who has become a Senior received a score in 
Test VI of less than 50, in Test IX, Part 3 of less than 24, 
and in Test IX, Part 2 of more than 50. 

On account of the complication involved in the use of four 
tests as part of the entrance requirement, we have recom¬ 
mended to the technical school that two tests only be used in 
the elimination of those from the course who are certain to 
fail. These tests are Test VI and Part 10 of Test IX. Others 
are to be given however, for their scientific interest. 

* Upon personal discussion with the teacher we found that this one 
success was a doubtful one. The probability that this eliminatioa can 
have taken place by mere chance is 1 in 26,518 worked out by the 
ordinary theory of probability, so that we may be reasonably sure of 
the causal relation between Test VI and success in stenography, 

" A high score in Part 2 indicates a poor standing, 
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Second, we attempted to select those from the group who 
were certain of success. In Chart III we have plotted Part I 
of Test VIII and Part 5 of Test VIII against each other. 
Again, O's represent successes and X's failures. Each person 
is numbered as before. The numbers below 63 represent 
Juniors, and 63 and above represent Seniors. It will be seen 
that a score above 10 in Part 1 Mid above 130 in Part 5 
indicates certain success. These grades should be used as 
critical scores in the employing of applicants when a large 
number are present from whom to make the choice and when 
no chances are to be taken on the success and failure of the 
applicant. In every employment office such instances arise. 
Considering Chart III from a mathematical view point, we 
find that each part predicts successes and failures as follows; 


Pay\ 5 —Critical ScorCj 130 

Failed in test and failed in course. 15 cases 

Failed in test and succeeded in course. 19 " 

Succeeded in test and succeeded in course. 39 " 

Succeeded in test and failed* in course. 7 " 

Total . 80 " 


This shows a correct choice of 67%. 


Pari 1 —Critical Score, 10 

Failed in test and failed in course,.. 23 cases 

Failed in test and succeeded in course.. 23 “ 

Succeeded in test and succeeded in course. 35 “ 

Succeeded in test and failed in course. 3 " 

Total . 84 “ 


This shows a correct choice of 69%. 

A combination of the two parts of Test VIII gives the fol¬ 
lowing results: 


Failed in test and failed in course.... 26 cases 

Failed in test and succeeded in course. 30 

Succeeded in test and succeeded in course . 28 “ 

Succeeded in test and failed in course.None 

Total . 84 " 


This gives 64%. correct choice. As will be noted, this cor¬ 
rect choice is not as great as for Test VI but the important 
thing to note here is that success in the tests predicts success 
in the course perfectly (100%). 
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Ifj on the other hand, we take 8 as the critical score in 


Part 1 and 120 as the critical score in Part 5, we have: 

Palled in test and (aited in course... 19 cases 

Failed in test and succeeded in. course. 1*1 " 

Succeeded lU test acid succeeded in course...., 44 *' 

Succeeded in test and /ailed in course..... 7 " 

Total ..-. 84 *' 
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This shows a correct choice of 779^. 

In picking our applicants that are sure of success we have, 
however eliminated some who would have succeeded, and 
therefore this criterion should only be used when the number 
of applicants considerably exceeds the openings in the company; 
or when the selecting of a failure would be a very serious 
matter. 

In Chart IV, we have plotted the scores of the comptometer 
operators in Test VI and Part 10 of Test IX. It will be seen 
that a combination of the two tests will eliminate 10 of the 
14 failures. The critical scores are 30 for Test VI and 60 
for Part 10 of Test IX. The chance that this is a mere chance 
elimination is 1 in 25,921. We have found no combination of 
tests for the comptometer operators that would pick successes 
more favorably than these two tests with which we have elim¬ 
inated the iailuies. This is due to the fact that at the present 
time we have no special ability test for comptometry. We 
hope in the near future to work out such a test. 

Putting the results on comptometer operators in mathe¬ 
matical form, we find that they predict success and failure as 
follows: 


Failed in tests and failed in course....,. 10 cases 

Failed in tests and succeeded in course. 0 " 

Succeeded in tests and succeeded in course.,.. 20 “ 

Succeeded in tests and failed in course. 5 " 

Total .. 35 " 


This shows a correct choice of 859b. 

Results 

I. A battery of tests is more effective both in eliminating 
failures and picking successes, than any single test. 

II. Of the single tests, General Intelligence is the most 
efficient for eliminating failures. 

III. Of single tests, the Special Ability test is most efficient 
for selecting successes. 

IV. Failures can be predicted by the tests with over 85% 
accuracy. 

V. Successful stenographers can be selected. 







MINOR STUDIES IN EDUCATIONAL PSYCHOLOGY 


By Frances I. Gaw, Boston Psychopathic Hospital, Boston, Mass. 


I. ScuoOL Ratings and Moving Pictuhes 
The educational value of moving pictures and their Influence upon 
behavior have been much discussed questions in the last few years, 
Educational films of various sorts have become common, and the 
release of such a picture as the "Fit to Fi^t Filin" in many camps 
during the war gave official recognition of the educational possi¬ 
bilities of movies, Dr. William Healy in his "Individual Delinquent" 
in reporting Juvenile Court cases where movies have directly affected 
conduct, says. " In nearly all people visual memory and visual imagery 
play the most dynamic part In mental life. . . . When it comes 
to motion pictures we have added elemcivts of force for the production 
of either good or bad." The importance of moving pictures as a 
melliod of popular instruction is borne out by the existence of such 
a publication as the Educational Film Magazine. 

This work was done to study the influence of movies on the conduct 
and school ratings of'337 children In a suburb of Boston. In this 
community there arc no moving picture theaters, and the sentiment 
against them is strong. The children studied were in the dth, 7th and' 
8th grades, They were given a questionnaire to determine how many 
movies they saw a month. Their ratings ip studies jaiid deportment 
were supplied by their school teachers, and correlations were then cal¬ 
culated between these averages and the number of movies attended 
monthly. The coelTicient was found to be, in the case of school studies 
and movies,—13. The correlation though inverse, is so low that prac¬ 
tically no relationship is shown between the two factors considered, 
In the case of deportment grades and movies attended, the situation 
is similar with a correlation of — 12, The average number of movies 
attended monthly was .97, or slightly less than one a montli. Only 
44 chlldi'en went as often as once a week, and only 6 more than once 
a week, Over half of the 337 children considered did not go to the 
movies at all. The two pupils with the lowest avcragc.s in their studies 
were among those who went to movies the most, although many of 
the other pupils low in their studies and those lowest in deportment 
went to the movies either an average number of times or not at all. 
A decided majority of the children with the best averages in both 
studies and deportment did not go to the movies at all. 

The following questionnaire (for which the writer was not re¬ 
sponsible) was used in gathering the data for this study: 

" 1. Do you go to the movies regularly? 

2. Do you go to the movies as often as once a week? 

3. Do you go to the movies as often as once in two weeks? 

4. Do you go to the movies as often as once in a month? 

5. Do you go to the movies less frequently than once a month?" 

Some children in answering bccatitc confused, contradicted them¬ 
selves and in a few cases added a question. - There were 4 or S ques¬ 
tionnaires so inaccurate that they could not be counted in the correla¬ 
tion. Such a questionnaire might well be modified to read: 
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1. Do you go to the movies at all? 

2. Do you go to the niovi^ as often as once a month ? 

3. Do you go to the movies as often as once every two weeks? 

4. Do you go to the movies as often as once a wegk? 

5. Do you go to the movies more than once a week? 

Whether or not this community is typical in regard to the number 
of movies the children attend, it is obvious that in this study the 
average movie attendance—once a month—is jiractically unrelated to 
cither the school work or deportment of the children consider^. 

II. Relations of Stanfoud Tests and Dearborn Maze Tests 

In this study, the reJationsli/p was studied between the Stanford- 
Binet mental ages of a group of patients at the Boston Psychopathic 
Hospital and their scores on Test No. 7, General Examination 5 of the 
Dearborn Group Tests of Intelligence, The Dearborn test used con¬ 
sists of four mazes. It is explained to the subject that the first two 
are maps of a city which he is to traverse in the shortest way possible, 
keeping in the streets throughout. The last two are also maps of a 
city which he is to traverse, stopping at certain points, but he must 
follow two definite traffic rules: first, he can turn only to the right, 
and, second, he must always stop on the right-hand side of the street. 
The third maze is divided into four parts. The first one of these 
was used as an illustration in the cases examined. Since this study 
was made, however, the third part also has been used by the author 
of the test as an illustration. The two more difficult mazes of the 
test are probably made considerably easier by this change. 

In addition to the patients tested, the Dearborn test was given to 
36 normal adults connected with tlie Psycliopathic Hospital, Most 
of these were physicians, social'workers and psychologists. Although 
this is a group test, it was given individually to many of the persons 
'tested, both patients and normal adults. 

The total number of patients tested was 77. Seven correlations were 
calculated by the ordinary Pearson formula. (The character of the 
data rendered rank difference methods impracticable,) First, the 
Stanford-Binet and Dearborn scores of the entire group were corre¬ 
lated, The r was found to be .52. The cases were then grouped 
according to diagnosis. It should be noted here that no patients 
were tested who were obviously psychotic, or whose scores would 
probably be lowered by their condition at the time of the test, Seven¬ 
teen fell into diagnostic groups which were too- small to be dealt with 
separately. The correlations between Stanford-Binet scores and Dear¬ 
born scores of the groups large enough to use were as follows. 
Using 14 cases diagnosed psychopathic personality r was ,36. When 
the records of two of the patients in this group were omitted, because 
of having driven cars under the same traffic rules as those in the third 
and fourth mazes of the Dearborn test, the correlation of the remain¬ 
ing twelve patients was 67. Fourteen cases diagnosed mental retarda¬ 
tion (subnormal intelligence) gave a correlation of —62. In this 
group, there were four cases of life ages respectively 15-4, 14-9, 12-11, 
10-6, These 14 combined with a group of 8 cases diagnosed mental 
retardation plus conduct disorder, gave a correlation of — 17. A group 
of 13 cases of conduct disorder gave a correlation of —IS, When 
these cases were combined with 7 others diagnosed conduct disorder, 
plus mental retardation, the correlation found was 7. 

In the group of normal adults the scores were consistently higher 
throughout than hi any of the groups of patients.' The accompanying 
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distribution compares the Dearborn scores of the normal adults, the 
cases of psychopathic persotiality and a group o{ the adult patients 
tested whose mental ages fall below 13 years, thirteen being considered 
the lower limit of average adult intelligence, Three Cases, one at 
score 15, one at score 19 and one at score 23, refer to the 3 individuals 
(2 patients and 1 physician) who have driven cars in cities under the 
traffic rules used in the third and fourth mazes. The median Dear- 
born score for the normal adults is 12.5, for the cases of psychopathic 
personality 5.5, and for the patients with mental age below thir¬ 
teen, 3.3. 

Dearborn Score 0123456789 10 11 12 

NomalAdults. 0001111126312 

Psychopathic Personalities... 1022200200100 
Patients with Mental Ages 

below 13.. 3 2 6 6 8 3 0 0 0 0 0 0 0 

Dearborn Score 13 14 15 16 17 18 19 20 21 22 23 24 25 26 

Normal Adults. 22210200023003 

Psychopathic Personalities OllOlOlOOOOOOO 
Patient with Mental Ages 

below 13. 00000000000000 

While the ability concerned in the maze tests is seen usually to go 
hand in hand with the more general intelligence criterion, it at times 
plays a more special role, notably below or above the general intelligence 
rating, Among the cases under diagnosis of mental retardation, this 
is So frequent as to give the expression of relationsliip its markedly 
negative value, —62. This is evidence of more disparate development 
of intelligence functions in this class of cases. 







COMMUNICATIONS AND NOTES 

INDUSTRIAL PSYCHOLOGY IN EUROPE 

To the Editors of the Journal of Applied Psychology: 

Sirs: I have j ust returned from a visit to the laboratories of indus¬ 
trial psychology in Europe, and inasmuch as several colleagues have 
suggested that a report of my observations would be of interest to the 
readers of the Journal of Applied Psvchology, I take pleasure in 
submitting an informal resume of my tour. 

In all the countries visited, I found the applied psychologists inter¬ 
ested in this held, though stressing divers points in approaching it. 

Ill England, industrial psychology, has a sort of official status, one 
important branch being under the auspices of the Industrial Fatigue 
Research Board (something like our National Research Council), 
which has been for several years investigating the relation between 
fatigue and various working conditions. Some publications of the 
Board arc already available, a list of which may be secured, upon appli¬ 
cation to the secretary at 6 John St, Adclphi, London, W. C. 2. The 
nature of the current investigations may he denoted by one which 
Miss Smith is conducting upon the conditions under which women 
work in laundries. I was struck with special force by the novelty of 
some of the methods that have been devised for measuring fatigue— 
not, be It said, by means of the oft-tried mechanical instruments; the 
attempt is made, rather, to express it as a function of the job itself. 

Another organization that indicates the English interest in industrial 
psychology is the National Institute of Industrial Psychology, 329 High 
Holborn, London, 

Though the operating center of these two organizations is London, 
the animating center is largely Cambridge. Dr. Myers has been ipde- 
fatjgable in his efforts to inaugurate and secure support for the work. 
As part of his program he called Mr. B. Muscio from Sydney to lecture 
at Cambridge upon industrial psychology and to conduct investigations 
in the laboratory. 

As I shall presently show by comparison, the English approach em¬ 
phasizes one point of view particularly. For example, tests do not 
bulk as large there as in some other centers, Nevertheless I am very 
optimistic regarding the results of tlie English approach to the problem. 
It has bearings beyond its ostensible aim of ameliorating conditions of 
work. It contitutes a long step in the direction of the too-long neg¬ 
lected analysis of the job, and as such it may furnish information 
useful in vocational selection and guidance, in increasing output, and 
in many other economic functions.^ 

In France I found lively interest in the psychological problems of 
industry, though it is scattered among several circles. A great part 
exists as le toylorisvie, which has developed into a veritable cult among 
French engineers, Its vogue has penetrated even into conservative uni¬ 
versity circles, as evidenced by the course given at the Sorboime by 
M. Charles Cestre, upon American methods of industrial management, 
M. Cestre introduced me to a half dozen of the leading economists 

^ Sec H. D. Kitson, “Scientific Method in Job Analysis,” J. of Pol. 
Eeon., XXIX (June, 1921), 508-514. 




288 


COMMUNICATIONS AND NOTES 


2 nd engineers who have organized for the sake of giving impetus to 
such movemenls, the SociSli d'eticourageineni m commerce el 6 1%. 
dustrie, 4 rue de Rennes, Paris. 

The chief investigations emanating from orthodox psychological 
sources are those carried on by M. J- M. Lahy at Paris. He lias writ¬ 
ten a hook, " Le Sysfcui Ta'^ar el la physiohgie du travail frofes- 
sionef." He is also secretary of the 1921 conference of industrial 
psychology which I shall mention presently. 

Further French Interest in industrial problems is revealed in several 
physiological studies, some upon fatigue, and some upon other effects 
and conditions of work. There is still another angle that is repre¬ 
sented—the pedagogical. Here the chief interest centers around voca¬ 
tional guidance, with considerable thought for the oI war. 

My visiting in Germany was confined exclusively to Berlin where I 
was conducted about cliiefly by Dr. Piorkowski who, with Dr, Moede, 
edits the journal, Praktische PsycltologieJ^ These investigators have 
an Institute with headquarters at the Technisclie Hocluschule located 
in the Charlottenburg section of Greater Berlin. Their activities are 
manifold. At the Plochschule they administer tests to students and 
apprentices; in the capacity of consultants they have introduced occu¬ 
pational tests into several factories in Berlin; and they publish the 
journal. 

The kinds of tests used follow largely the Mnensterberg tradition oi 
attempting to reproduce the work to be performed, in diminutive and 
elemental form. For example, the test for aptitude for running a 
machine requiring retention and reproduction of a certain pressure 
just made by the hand, consists of an apparatus upon which the sub¬ 
ject can exert a pressure which is recorded, and which h<; afterwards 
reproduces as closely as possible. The two kymographic records are 
then compared, giving an “ aptitude index.” Further examples of the 
tests employed and the methods employed in evaluating them may be 
found in the pages of "Praktische Psydiologie." 

In order to save me time and energy in viewing all Ihcir activities, 
my German hosts had prepared a threc-rccl him showing the operation 
of many varieties of tests. This they presented to me in private 
demonstration. They informed me that they would be glad to dis¬ 
tribute this in the United States at the price of three hundred dollars, 

During the week I was in Berlin a series of intcUigence tests was 
being administered to children just emerging from the Mitlelschitle, in 
order to select a certain number as entrants in a school for gifted 
children. A large group had already been selected on the basis of 
scholarship; and they were being still further sifted by means of in¬ 
telligence tests. The day I observed the work about 150 girls were 
gathered in the grand council-chamber of the Berliner Ralliaus for 
testing. The tests employed were the traditional word-building, com¬ 
putation, Ebbinghaus completion, and the like. The testing went very 
smoothly but very slowly. The children wrote on separate sheets of 
paper torn from booklets similar to the examination " blue-books ” of 
American universities. For three hours tliat morning the children sat 
and took tests with only a fifteen minute intermission. Tlie work of 
that morning represented only a small portion of the total undertaking, 
an entire week being required for testing all the children. The work 
of scoring papers must have been mountainous. Some of our Ameri- 

2See H, C, Link, “A New Journal of Practical Psychology,” J. of 
App, Psycliol.j V (Maroh, 1921), 85-86. 
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can psychologists who are specializing in forms of intelligence tests 
and in devices for increasing efiidency in their administration may 
find a good market for their vrares in Berlin. 

At Geneva, I found the JtksHluf J. J. Rousseau likewise interested in 
industrial psychology. This institution, founded in 1912 under the 
direction of Professor Claparedc, is devoted chiefly to the application 
of psychology to educational problems. But in the light of recent 
movements in vocational education, the Institute feels itself bound to 
direct a moiety of its energies into the industrial held, As early as 
1916 a rather pretentious attempt was made to formulate a series of 
tests for telephone operators. The results were published in the 
Archivs de Psychologie and furnished a pattern for several similar 
investigations in Europe. Occupations that the Institute has since ap¬ 
proached analytically in various Swiss factories and technical schools 
are watchmaking, various operations of the machinist's trade, and sev¬ 
eral occupations for women. The report of this latter group of stud¬ 
ies, M. Bovet, Director of the Institute, assured me, is in fair way to 
publication. 

A considerable amount of attention is being paid on the continent 
to vocational guidance, or “ orienfotiou firofessioHellg/ as it is called. 

I found two books upon the subject in French, and two journals—one 
in French, and one in Spanish. Germany has a national association of 
vocational guidance of which Dr. Moede is president, And all Europe 
has inaugurated a series of annual conferences. The hrst one was 
held last year at Geneva. The second (Deuxthne Conference Inter- 
iiationcle de Psychotechmque Appliquie i I’ortenlafion professionelle 
et d I’crganisatuin du travail), will take place at Barcelona September 
2S-30, 1921. The program is divided into three sections: Section, 1, 
(a) Vocational guidance; (b) motion study; (c) occupa^onal fatigue. 
Section 2, Psycnographic methods (especially ‘for schoo!s)v Section 
3, Tests. The conference will be entertained by the personal of 
L’Institut d'orientathn professionelle of Barcelona. I should like to 
have stayed over for this conference and have brought back a com¬ 
plete report of it but I Itad not made arrangements to miss the opening 
weeks of the university.® 

From observations such as those I made, one may conclude that the 
interest in industrial psychology is just as keen in England, France, 
Germany and Switzerland, as it is in the United States, It is very 
intense, and is animated by high moral and patriotic motives of im¬ 
proving conditions of labor, raising the efficiency of production, guid¬ 
ing young people (especially those maimed in the war) into appro¬ 
priate occupations, and educating them with effectiveness and dispatch. 
In each of the countries emphasis is placed upon one or another of 
these phases. In England, perhaps it is chiefly directed toward the 
amelioration of working conditions; in France, toward raising general 
technical efficiency; in Switzerland toward vocational guidance, or at 
least, vocational education. 

Intense though the interest is, it is not as extensive, however, as 
that in the United States. (There were only about twenty in attend¬ 
ance at the last meeting of applied psychologists at Geneva,) One re¬ 
ceives the impression that European psychologists look with consid¬ 
erable admiration upon the achievements of American psychologists in 

® The editors are pleased to announce that through Mr. Kitson’s 
efforts they hope to present the outstanding features of the conference 
in a later issue. 
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this field, particularly upon the personnel activities of the army. (I 
think I am betraying- no professional or military secrets in remarking 
that there has been serious talk o£ adopting our personnel methods in 
the Swiss army.) 

The European investigators are generally acquainted with our books 
upon the subject, but not with our periodical literature, Nowhere did 
I find in use the recent forms of our Iwcnty-scvcii varieties of intelli¬ 
gence tests, Nowhere did I find test-booklets, ‘'cross-out" elements, 
scoring stencils, simplified statistical methods and other aids to cih- 
ciency so common in the States. I suggest, therefore, tliat any Ameri¬ 
can mental testers who are anxious to spread the use of their tests 
may profitably place on their mailing-lists the following European 
names; 

Dr, C. S. Myers, Psychological Laboratory, Cambridge University. 

Mr. B. Muscio, Psychological Laboratory, Cambridge University. 

Mr, G. H. Miles, 329 High Holborn, London, W- C. 

Mr, D. R, Wilson, 6 John St, Adelphi, London, W. C. 2. 

Mr, Eric Farmer, 6 John St, Adelphi, London, W. C. 2. 

Miss May Smith, 6 John St, Adelphi, London, W. C, 2. 

Dr. W. Moede, Berlin, W. 30, Luitpoldstrasse, 14. 

Dr. C. Plorkowski, W- 30, Luitpoldstrasse, H. 

Professor Ed, Claparede, Psychological Laboratory, University of 
Geneva. 

M. Heinis, Psychological Laboratory, University of Geneva. 

M. Pierre Bovet, Director Institute j. J. Rousseau, Geneva. 

Madame Chavennes, Institute J. J. Rousseau, Geneva. 

Mile. Chavennes, Institute J. J. Rousseau, Genova. 

M. J. M. Lahy, 12 rue Ltnne, Paris. 

The trip showed me that the problems which confront industrial 
psychologists are similar, whether in Europe or America, and that 
when approached from the scientific point of view, they lead over 
quite similar pathways. It also showed me that in spite of the mere 
three thousand miles that separate our coasts there is regrettable lack 
of acquaintance between applied psychologists in Europe and Amcrlcai 
And that in order for a maximum of progress to be made by bo^ 
groups there must be deliberate and constant cllorts towards faciliating 
a rapprochewent. 

Professor of Psychology, Indiana University, 

Bloomington, Indiana, 


HASKY DEX'Ili.tl KITSON 


THE NATIONAL INSTITUTE OF INDUSTRIAL PSYCHOL¬ 
OGY OF THE UNITED KINGDOM 

For some time the more progressive firim in this country have been 
Interested in the applicattoti of psychological and physiological principles 
to industry and commerce. The Industrial Fatigue Research Board 
which was established in 1915 has already done much to show the 
possibilities in this field. Its activities are however necessarily con¬ 
fined to broad surveys and investigations of common problems and it 
was felt by many firms interested, that much of the value of its work 
would be wasted unless assistance could be obtained in the application 
of the_ principles to the special needs of individual firms. This work 
is obviously beyond the scope of a Board supported by public funds 
and in order to meet this need a National Institute of Industrial 
Psychology has been formed. This was incorporated under the Com- 
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panics Act on February 11, 1921, as an Association for Scientific 
Research. It has the support of a number of well-known business 
men and in addition has a Scientific Advisory Committee consisting 
of the heads of psychological, physiological and educational depart¬ 
ments of Universities throughout the Kingdom who are interested in 
the practical application of the sciences of Psychology and Physiology, 
Private individuals have come forward with generous financial sup¬ 
port, and in addition the Carnegie United Kingdom Trust is giving 
substantial help. Where investigations are carried out which are 
likely to result in an immediate advantage to a firm, fees are charged 
which cover the salaries of the investigators and include overhead 
charges of the central body. 

The Institute is under the direction of Dr. C. S, Myers, M. D., 
Sc, D., F, R. S., and by arrangement with the Industrial Fatigue Re¬ 
search Board the services of Aeir investi^tors may be utilized when 
required to supplement the work of the Institute's investigators. 

On the industrial side of the Institute's activities investigations are 
now being conducted in factories concerned in the work of presses, 
box and can making, soldering, chocolate dipping and packing; inter¬ 
esting problems concerning layout, size of material, rest pauses, selec¬ 
tion tests, seating accommodation and ventilation have arisen and are 
being examined. 

On the commercial side the formation and trying out of a suitable 
series of selection tests for the clerical staff of large firms is being 
undertaken, which promises to prove most useful. 

When more detailed information is obtained as a result of these and 
other investigations, the Institute will be in possession of material 
invaluable for Vocational Guidance.^ By cooperation with a number 
of leading education authorities definite and scientific lines of approach 
will be formed between the school and business life so that a hoy or 
girl, on leaving school, will have the opportunity of obtaining more 
exact and scientific guidance than has been possible in the past. In 
this way it is hoped that much of the waste of national energy which 
takes place in the intermediate stage by haphazard drift and false 
starts will be avoided. 

The Institute is therefore making a more widespread appeal to all 
those who arc Interested in this work. That it has been possible to 
advance so far in a time of such severe financial depression is a hope¬ 
ful promise of greater activity in brighter times. Meanwhile active 
propaganda work is being carried on, both amongst employers and 
employees, and lectures dealing with the subject are being arranged. 
The results of the work and a full survey of the work of similar 
character carried out by other similar bodies abroad will be published 
by the Institute in the form of a quarterly journal. 

The Secretary of the Institute is Dr. G. H. Miles and the head 
offices are at 329 High Holborn, London, W. C. 1, 


We are indebted for the above account of the work of the National 
Institute of Industrial Psychology of the United Kingdom to the 
Director, Dr. Charles S. Myers. 
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Kempf, Edward J. Psychopathology. St Louis, C, V. Mosby (To., 
1920, pp, 762. 

“It is comparatively simple and very easy to be an extremist in 
anything, but it requires eternal care, sound common sense, and no 
little patience and endurance to maintain a progressively refining, 
healthfully constructive attitude toward the fundamental needs and 
pleasures of human nature.” "When the above statement appears as 
early as the third page of this recent contribution to psychopathological 
literature, the reader is inclined to assume a rather comfortable pos-- 
lural tonus and approach the volume with the expectation that perhaps 
at last has been found the long anticipated volume which is to safely 
point a' course between the extremes of too rigid conservatism and 
too liberal psychoanalytic deductions. Surely a writer who voices the 
need of “eternal care” and "sound common sense" will not fail to 
heed his own warning. For the reader expecting a conservative inter¬ 
pretation of human adjustment, there is increasing disappointment. 
He will find here outlined, no medium course, but still another extreme 
contribution to psychopathological literature, which he must appraise 
and, after selection and rejection, weave into his own hypotheses. 

Of one thing there can be no doubt. Kempf himself is sincerely 
convinced of his theory and is most eager to proselyte. In fact, his 
enthusiasm is so contagious that there is danger of uncritically ac¬ 
cepting statements for which reason forces, if not rejection, at least 
serious question. In actual presentation of data, Kempf seems so 
anxious to get his view point before the public, that he takes no time 
to refine. As a result there is much to be criticized in his style. It 
is neither consistently popular nor consistently scientific. One finds 
tedious repetition, unnecessarily long and involved sentences, an occa¬ 
sional incomplete sentence and illustrations ad infinitum, It is to be 
regretted that “Psychopathology” is not presented with the fineness 
of expression of'"The Yellow Jacket.” Unkindly criticism might 
characterize Kempf's present style as he does his patients. " The large 
number of unique words which he used to express a simple thought 
was unusually impressive.” (Page 436.) Again, "lie used numerous 
polysyllabic words with little regard to their meaning," (Page 530.) 
It would indeed take a clever reader to grasp the meanings of " good¬ 
ness ” and " happiness ” from a study of the wordy definitions on page 
118, However, it is his coarseness of expression which can least be for¬ 
given, Kempf himself calls attention (page 3) to the biological de¬ 
structiveness of the tendencies to vulgarly and to prudishness. Cer¬ 
tainly the way to overcome "prejudice, prudery, or mock finery" ia 
not by actual coarseness of expression. The latter is quite unnecessary, 
however "delicate” the situation discussed, 

To understand Kempf's dynamic, autonomic mechanism of the per¬ 
sonality, one must appreciate first of all the tremendous emphasis 
placed upon the autonomic system. He assumes that "the cUllerert 
segments of the autonomic apparatus are stimulated to assume dif¬ 
ferent types of postural tensions and activities, which give rise to an 
affective nervous stream, which, in turn, coordinates the projicient 
apparatus and compels it to act so as to expose the receptors of the 
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organism so that they will acquire certain types of stimuli and avoid 
others, The stimuli must be acquired in order to avoid prolonged 
unrest and distress, which may become decidedly malnutritional in 
their influence, must have the capacity to counter-stimulate the au¬ 
tonomic segment so that it will resume a state of comfortable tonus." 
(Pages 9-10.) "Emotions and sentiments are cravings that have their 
origin in the tensions and movements of different autonomic (vis¬ 
ceral) segments." (Page 6.) If emotions have a peripheral origin 
in the characteristic variation of the postural tensions or visceral seg¬ 
ments, it is clear that at a given time, the individual, although he may 
be dominated by a distinct craving, nevertheless is never possessed by 
a single affective craving. Gradually the autonomic segments become 
conditioned to seek only such stimuli as are approved by the social 
group, Will becomes the wish for the esteem of the group, With the 
integration into a unity of these segmental cravings, together with 
one's strivings to win sodal esteem, there develops a personality, the 
Ego. Normally, of course, only appropriate stimuli would satisfy seg¬ 
mental cravings and so neutralize tension, but unfortunately, it is quite 
possible for the organism to become conditioned to demand less appro¬ 
priate stimuli and thereby we have within a single personality the 
basis for possible conflict between segmental cravings and the striving 
for social esteem. Out of sucli conflict arise the mechanisms of sup¬ 
pression, repression, dissociation, and sublimation, In general, then, 
to Kempf behavior becomes largely a problem of supplying the maxi¬ 
mum gratification with the minimum expenditure of energy for seg¬ 
mental cravings, at the same time preventing gratification at the expense 
of social esteem. Eccentric behavior becomes a compensation for per¬ 
verse cravings. A segment denied reality must have a substitute. 
Delusions, hallucinations, and dreams, however bizarre, are but means 
of gratifying cravings which cannot be gratified by reality, 

In appraising Kempf's theory two questions arise: First, what of 
the validity of the physiological data, the very foundation on which 
the psychological structure rests? Second, are we justified in consid¬ 
ering the affect as purely autonomic in origin? For the physiological 
data, Kempf finds justification for his point of view largely in the 
work of Sherrington, Langelaan and Cannon, Even a casual reader 
might question the sweepingness of certain of Kempf's deductions from 
the findings of these men. Adequate criticism belongs to the neurol¬ 
ogist or physiologist rather than psychologist. So far as the second 
question is concerned, does not Canndn himself raise the question 
whether organic changes are sufficiently differentiated in various emo¬ 
tions to account for the affective differences? 

As regards Kempf's interpretation of behavior there is indeed much 
that is illuminating, particularly in his emphasis upon the importance 
of the Ego's attitude toward the cravings as determining whether his 
adjustment shall be one of submission, elimination, simulation or sub¬ 
limation, Certainly such an explanation renders intelligible much that 
might seem utterly unintelligible, particularly in pathological behavior. 
Whereas by and large such mechanisms may be acceptable, there are 
times when the Interpretation invites reductio ad absurdura. One may 
grant that Darwin may have had an inferiority complex and yet ques¬ 
tion whether it be necessary to assume that his use of a high stool in 
studying was to elevate himself above his fellows, thereby compen¬ 
sating for his feeling of inferiority. One may grant that a patient 
attempts to compensate for his impotence through the construction of 
a perpetual motion machine, and yet hesitate to see in invention in 
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generai a compensation for the wastes of masturbation, One familiar 
with the number of objects on a psychopathic ward which would be 
available for swallowing, can hardly fail to feel tlie overemphasis on 
the swallowing of the ticking watch by the woman patient in simula¬ 
tion of pregnancy. Certainly an interpretive analysis of cases should 
be substituted for the older description of symptoms. Kcmpf’s “ Psy¬ 
chopathology " has been of no little value if it stimulates interest in 
case analyses. Whether one must ultimately approach all such anal¬ 
yses from the autonomic slant is another question, 

As would be expected Kempf makes generous use of the psycho¬ 
analytical stock of symbols. In his case studies, their use is what 
might be expected from any thorough going analyst. However, his 
interpretation of the symbolic significance of various works of art, 
suggests that he can sec only what he is looking for. For example, 
he cites Rodin's “Caryatid"—a woman’s figure crouched beneath the 
weight of a burden resting on her shoulder. At once, Kempf sees in 
the bowl only the psychoanalytic symbol for the uterus, the shoulder 
is a convenient substitute, and the statue becomes symbolic of the 
"burdensome uterus and longing for maternity.” It is interesting to 
question to what extent one is justified in reading an interpretation 
into another’s creation. One might also raise the question whether 
the contemplation of this statue would afford relief from repressions 
of the type indicated. So far as the psychology of art is concerned, 
stone obviously from the inherent qualities of the substance itself is 
adapted to a representation of the type or symbolic rather than the 
individual or pictorial. But why must all that is symbolic be symbolic 
of libido at a crude organic level? 

Certain it is that no one can contemplate Kempf's interpretations of 
the mcchanisins of human, adjustment witliout finding much that is 
illuminating and stimulating. Accepted in tolo, however, it is legiti¬ 
mate to ask whether such a point of view is conducive to the develop¬ 
ment of that much to be desired "progressively refining, healthfully 
constructive attitude toward the fundamental needs and pleasures of 
human nature," Is an interpretation of life which sees the great driv¬ 
ing forces of human behavior as purely organic, conducive to the 
development of a civilization that will survive? Regardless of its ac¬ 
ceptability or rejection on purely emotional grounds, is it not clear 
that such an ideal would be biologically and ethically a regression? 
The ultimate test of course is pragmatic. Kempf freely criticizes the 
"biological castration influence of present American educational and 
social tendencies" but does not adequately outline a program lor their 
reconstruction. Until he does, it is left to the imagination of the 
reader to reconstruct a social order in accordance with an ideal of an 
organic summum bonum. Such an attempt at reconstruction makes 
particularly clear the social and ethical implications of an autonomic 
ideal and protects against too uncritcal acceptance. 

The following books and pamphlets have been received: 

James Drevee. — The Psychology of I%ditslry. E. P. Dutton Co., New 
York, 1921, 148 pp. 

---. The Psycholcgy of Everyday Life. E. P. Dutton Co,, New 

York, 1920, 164 pp. 

Henry R. Evans. Edwatiowl Bowfds and Foitndotioji.j, 1918-20- 
Washington Govt. Printing Office, 1921. 11 pp. 

JuUA Wade Abrot. Kvudergoirten £dircation, 1918-20. Washington 
Govt, Printing Office, 1921. 12 pp. 
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Ur. A, A. Rodack. Roback Menlality Tests for Superior Adults. Cam¬ 
bridge, Mass, 14 PI). 

John J. B, Moiigan. Morgan's Mental Test. Psychopathic Hospital 
State University of Iowa. 8 pp. 

Helen T. Wooley, Ph,D. and Hoknell Haet. Feeble-Minded Ex- 
School Children. Studies from the Helen S. Trounstine Founda¬ 
tion, 25 East Ninth Street, Cincinnati, Ohio. April 1, 1921, 27 pp, 
Price 50 cents; 4 or tnore copies, 25 cents cadi: in set with 6 
other studies $1.00. 

H. R. Bonner, Statistics of Universities, Colleges and Professional 
Schools, 1917-18. Washington Gov’t Printing OITice, 1921. 223 pp. 

Wm. R. Hood, State Laws Relating to Education. Washington Gov't 
Printing OITice, 1921. 231 pp. 

Chas. S. Myers, Mind and Work. C P. Putnam's Sons, New York 
and London. The Knickerbocker Press, 1921, 175 pp, 

Harry Dexter Kitson, Ph.D. The Mind of the Buyer. The Mac¬ 
millan Co,, New York, 1921. 206 p. 

Alexander Inglis, Inglis Intelligence Quotient Values. World Book 
Co,, Yonkcrs-oii-Hudson, New York, 16 pp. 
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1 

.Stui)Y ok SeM'-Assuhanci; 

/iKoIyjij of the Trail 

T)ie )oo.si'nt*s.s of ;iltnc)}cd lo nances of character 

trails (K*nian(ls first consideration. A trait must be defined 
in order to lie studied inlcni|;ently. Hecausc definition cannot 
be made witli any de^jrt'c of accuracy is no good reason for 
neglect of it. A little altenipt to see as a whole and Ln its 
various aspects the trail xvliich one studies is sure to be more 
eJTeclive than the pn^ccdiirc of dcvi.sing tc.sls and naming 
them as measures of anything at all. 

Let the folliiVr'iug table 1 ilUisiralc an attempt at definition. 
It is a list of typical situations whicli commonly evoke the 
reactions tlial are. given this trait-name, together with the 
reactions comprising the trait. That is, reactions which would 
represent a high degree of the trait arc listed (In the second 
column) and negative responses, re|)resenting a low degree 
of the trait, are also shown (in the third column). The un¬ 
derlined qualification which appears prominently in the table, 
OTHER I’AC'l'ORS BEING EQUAL, demands constant 
cmjiliasi.s. Not only self-assurance but a host of other traits 
and condition.'! might be responsible for the reactions listed, 
These other factors must clearly be discounted or equalized 
before tlie reactions may be viewed as symptoms or measures 
of self-assurance. In cxpcrmient they must be recognized and 
evaluated or controlled. 

In .spile of it.s incompleteness and its errors (one error 
will b(! pointed out later im (he basis of experimental findings), 
the table at once shows its usefuliie.s.s. One devises tests 



TABLE I 

Showing Typicai, Situations and Reactions Involving Self-a: 


298 


FILTER 


in 


1 - 

I 

^ ^ tfl 

if q 

Jo 'g-U 

K ^ r.’o 


O -Sp 

3 


c . 


O o o 
u ijrp .2 


8 -il I 

U U ^ O’ 


II ^ 


M cn 


w u> 


12. Contradicted ■when assertjng^ ore’s own Denial of error. Acceding. 

memory of an event, act, etc. 

13. Contradicted in personal convictions by Maintenance of conwction (not nec- Suggestible (Re matters of opinion 1 

authority and by associates. essarily public expression). 
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wliicli shall Hiiproximalr nomc one or a few of these type situa¬ 
tions, and then the table does its further service of preventing 
generali/ntioiis. Successful measurement of some one aspect 
or cIctiHMU of llu! trail must clearly he regarded as no measure 
of tlie trail. Unlil its relation to the trait in all of its asi>ects 
is (iclenniiu'd, no .single measure can Iw safely labelled as a 
test of .‘iidf-assurance and he used as such. 

/'.lY'i'MOifn/fif I^rocvdurc 

In addition to die recognilioti of flic complexity of a char¬ 
acter trait there is necessary some insight into its nature as an 
altribvile of individuals. Is it a relatively constant or a vari¬ 
able allrihuti! ? 

I.ct us restrict ihe im|uiry at first to just one aspect of the 
trait, namely to item N(». 1] in table I, to exprcssion.s of tenden¬ 
cies towards over-estimation. Tlie prohlcin is, to wiiat extent 
do |)er.sons who over-estimate (or undcr-cstiinate) their capac¬ 
ities in om; situation.on one kind of material—’teitd to do so in 

ollu'i' .situatioits on nthei‘ malei'ials? 

'I'lu.' dinV'rciil Itsis wliich were devi.sed, and applied, vary in 
value as controlled measures of nver-e.sliiualiuii. Only two of 
lliein arc wiirlliy of coiiipleli: dtscrl|)lion. 'I'lu'se two tests, 
however, do seem to possess advantages wliicli siiould l)c noted. 
In the liisl place, lliey .serve the present lairpose very well, 
of prcM'Dling I wo siMintioiis for compari-son, winch are identi¬ 
cal in evo'ty tesprel exeepling ill the intiller of material on 
vvhich the estimati’ is based, 'lest No. I calls (or estimates of 
one'.s capaeiiy to manipulate; test No. 2 calls for estimates of 
one's dumciiy to reorgaiii/e and reproduce visual impressions; 
botli nclivilic.s are r/pially unfamiliar or eipially nnprncticed (at 
least in tlie ease of all the svihjects to lhc.se experiments) ; 
and luamicr of pre^^onialioii of the mtilerial, and all other 
conditions are identical. In the .suconcl jdace, hotli tests arc 
ohjectively scoraUle. 

Test No, 1. S'J'KING 1'I(IUU1*1S. (Pholograph.s from Caro¬ 
line I'hirness Jayne's book, "String logures,” C. Scribner’s 
Sons, lf)05.) 

Ih eliniinary; d'ask was to reproduce witli loop of string 
on finger.s [jaUerns siiown clear and traceable on pictures. 
Tliiee patterns, a very simple one and two of repiesciUative 
comiilexilv, weia: tried, an<l Subject informed regarding the 
amount of lime lie nea-ded fur each. 

'Fcsl (Jiiesiion; Showing .S tmi inon-. one at a timir, ask; 
" Wliich ones (if these do yon feel sure you would be able to 
do if allowed 4 miimles for each?” 
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Criterion of Self-assurance: Number chosen plus number 
over-estimated (as shown by actual performance tested later). 

Measure of Speed of Decision also obtained; Total time 
from, moment No. 1 is handed to S until No, 10 has been chosen 
or discarded. S not aware of the fact that time is being taken. 

Test No. 2. DECOUPAGE. (Binet’s test extended.) 

Preliminary : Task was to " Draw what the folded and torn 
paper looks like opened up.” Three different patterns tried, 
the original Binet and two other simple ones. Subject allowed 
to compare his drawings with the actual pattern. 

Test Question i Ten more are folded and torn, and S asked 
after each one—“Could you do this one correctly, if you 
were to see it folded once more later. Just before drawing it?” 

Criterion: Number chosen plus number over-estimated;. 
Speed of Decision measured;—total time of choice—the fold¬ 
ing procedure being practically constant for each S. 

Dr, June Downey's Will Profile (U. of Wyoming Bulletin 
No, 3, 1919) contains a test of Assurance, which was utilized 
in this study. Two sealed envelopes, one stamped M and the 
other N, are held before the subject for selection. They are 
then put aside for a while, and when later brought under 
reconsideration, E makes a point of contradicting the asser¬ 
tions of S relative to which of the two envelopes he had 
previously chosen. Degree of resistance to contraefiction i? 
scored by comparison with standard sample responses. The 
scoring of this test is not strictly objective as in tests No, 1 
and No. 2. 

Two tests of Speed of Decision were also given. Accord¬ 
ing to the definition of the trait, table I, items 8, 9 and 10, 
speed of decision was presumed to be to some extent indica¬ 
tive of self-assurance. Therefore measures of speed of de¬ 
cision were secured in connection with tests No. I and No, 2, 
and two more tests of speed of decision were borrowed. Again 
Dr. Downey's Will Profile provided a measure, in the Char¬ 
acter Checking Test. A list of character traits in pairs is pre¬ 
sented and S instructed to check the one trait in each pair 
which he thinks he possesses. Amount of time employed 
determines the score. 

A modification of Miinsterberg's Decision test, the form de¬ 
vised by Sybil Marsh Gibson (A Decision Study of 150 Young 
Men and Women, J, vf Applied Psych., Dec. 1920), consti¬ 
tuted the other test of speed of dedsion, Cards bearing the 
letters E, I, Y and K, in scattered arrangement, are given S 
to be examined. S is to decide, without counting, which one 
of the four letters appears most often on the different cards, 
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Time and accuracy can be scored, but only time was scored 
for the purposes of this study. 

These tests were given to a group of 26 University stu¬ 
dents, members of several classes in psychology, and yielded 
the following results. Disregarding for the present the bear¬ 
ings of speed of decision, and confining attention to the three 
tests of assurance, the correlations by Rank Difference Method 

were, Between Test No. 1 String Figures 1 = no 

and Test No. 2 Decoupage \ ^ 

Between Test No. 1 String Figures 1 

and Test No. 3 Assurance (Downey) U ' 

Between Test No. 2 Decoupage 1 _ 

and Test No. 3 Assurance (Downey) U ' 


Here is a fair demonstration of variability. If it were 
established on the basis of a greater number of cases we should 
conclude that possibly our trait of Self-assurance is purely a 
function of external factors—of the particular situation—and 
110 constant attribute of individuals at all. What is unequivo¬ 
cally demonstrated is the fact that no one of these tests can 
be rightfully used alone as a measure of assurance. 

Tests No. 1 and No. 2 are of a nature which permits of re¬ 
petition on the same individuals, after an interval of several 
months probably, and their reliability may be determined. This 
has not yet been done. 

An attempt has been made to determine the validity of the 
tests as measures of self-assurance through correlation with 
estimates. A rating .scale was prepared which described six 
types of individuals, varying in degree of self-confidence, with 
a grade assigned to each; and then groups of subjects were 
found who were well acquainted and who provided estimates 
of each other. The rating scale was successful in serving as 
a real aid to the judges and in securing very close agreement 
(M. V, slightly more than a half step) in the different esti¬ 
mates of the same person. But no test results were found 
to correlate very high with the estimates. 

TABLE II 


Correlations with estimates. Two 

different 

groups: 

6 boys, members of one 

fraternity. 


14 girls, members of one sorority. 


Measures of Over-estimation ( 

) OSes 

14 cases 

Test No. 1 String Figures r = 

.70 

.32 

Test No. 2 Decoupage 

.70 

.28 

Measures of Speed of Decision 



Time In Test No. 1 

.07 

-.14 

Time in Test No. 2 

.19 

—.42 

M. Decision Test 

—.10 

.54 

Character Checking 

.17 
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It became apparent that a mistake was made in attempting 
to correlate specific test results with estimates on self-assur¬ 
ance considered generally. In order that estimates may serve 
as a criterion of a test they should be based upon knowledge 
of activities related to those involved in the test, and upon 
such activities alone. The scale should be replaced by a 
number of scales, each descriptive of some different specific 
kind of self-assurance. In the same manner as the subjects 
were graded by friends for self-assurance in general (on the 
scale used), they might be graded for scH-assuvance in lim¬ 
ited spheres of definitely specified types of situations—in 
matters of athletics alone, or matters of scholarship alone, 
or in handiwork, or brain work, or in home circles, or in public 
view, etc., etc. 

The following table III summarizes all of the correlations 
between measures of speed of decision. The correlations are 


based on as many cases as could be compared, regardless 
of groups, 

TABLE III 

No. of cases 

20 Time in String Figures and Decogpage. r ,38 

20 Time in String Figures and M. Deo’sion.,.. .29 

20 Time in Decoupage and M. Decision.'.28 

(Subject No. 42 was first in speed 
in all three of these tests.) 

22 Time in String Figures and Char, Checking. .30 

.33 Time in Char. Cliccking and M, Decision.,, ,15 

45 Time in M. Decision and Accuracy in same. —.50 

14 Average rank in Speed of Decision and Esti¬ 
mates ... —.02 


Conclusrotts 

Evidence showing that the two original tests, No. 1 and No. 
2, actually serve as measures of Self-assurance is not at hand, 
That they possess certain advantages, however, was notice¬ 
able to all who studied the tests and observed the reactions to 
them. The most promising features may be enumerated as 
follows; 

1, Scorable on a strictly objective, quantitative basis. 

2, Reactions represent actual attitude of S, not a mere guess 
without insight. 

The trials given are directly comparable with the material 
estimated. 

3, Other factors fairly well controlled. 

The objectivity of the material precludes likelihood of much 
change in reaction under varying subjective conditions, 

Test activity uninfluenced by experimenter. 
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Recognition of purpose of the test makes little difference. 
Desire to show much confidence in estimating is counter¬ 
balanced by desire to show ability to perform the patterns 
chosen. 

Note the correlation of —.02 between average rank in speed 
of decision and e.stiniates on self-assurance, Though the 
criterion is faulty, as already indicated, it nevertheless serves 
for comparison and probably has some value for showing 
general relationship. Whereas the measures of over-estima¬ 
tion showed low but positive correlations (table II) with the 
estimates, none of the measures of speed of decision show con¬ 
sistent agreement; and their combined effect (table III) is 
seen to be entirely unrelated. 

A distinction wliich was not made in Table I, where the 
trait was defined, is brought to mind by this observation, 
namely a distinction between decisiveness, or strength of de¬ 
cision, and confidence in one's own powers, or self-assurance 
ill its true meaning. It is a distinction between the manner 
in which the decision is given, and the kind of decision given, 
Speed of decision, as a mode of decision, is probably an 
expression of decisiveness rather than of self-assurance. At 
least, it does not appear to be the latter. Items 9 and 10 
in the table I, defining self-assurance, should evidently be dis¬ 
carded. Whether other measure.s of decisiveness (such as 
can be secured by answers to the question, how sure are you? 
by double checking answers, etc.), whether these show a close 
relationship to measures of speed of decision, has not been 
determined. Their relation to measures of self-assurance 
should also be ascertained. 

Quite clearly, too, Sj5ecd of Decision seems not to be meas¬ 
ured adequately by the Downey Character Checking test, nor 
by any other single test. Surely when we speak of speed of 
decision we are as likely to be understood to mean that an 
individual will decide quickly how much or how difficult 
laboi' he can undertake (the consideration under tests No, 1 and 
No. 2) as to mean that he will quickly decide which trait he 
possesses (the consideration in the Character checking test). 
And the results show (table III) that to measure speed in 
one gives little or no indication of speed in the other type of 
decision. Such facts should be kept in mind when speed of 
decision is the subject of conversation. 

Possibly if a larger group of persons is brought under exam¬ 
ination in a greater number of tests a degree of constancy 
or generality of the trait may be discovered, but we have no 
evidence e^f that |M>ssil«lily beyond the one presented here 
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in the case of our subject No. 42, who led in speed of decision 
in three tests, choosing more rapidly than all her comrades 
in String Figures, Decoupage, and M. Decision test. It is 
exceedingly regrettable that the Character Checking test had 
to be eliminated from her group because of mere lack of time. 
(S No, 42 was ranked 8th, witli grade C, for Self-assurance by 
her friends,) 

Speed and Accuracy in the M. Decision tc.st show a distinct 
negative correlation (r —.50). 

The extension of these tests to a greater number of sub¬ 
jects, and also comparison with a greater luimbcr of similar 
tests composed of varied kinds of material, is e.ssential to the 
definite determination of whether the tendency towards over- 
estimation is or is not a highly variable and unpredictable trait, 
and whether or not any one test may he expected ever to serve 
as a measure. 

With reference to the general program of learning some¬ 
thing about Self-assurance, it is demonstrated emphatically 
that we h.ave succeeded no farther than to outline the problem 
and discover the difficulties that beset its solution. The way 
for progress is indicated to some extent in our recognition 
of the need, just expressed above, of completing first the 
observations relative to the one assumed element of the trait, 
Over-estimation. We need to know whether or not the tendency 
to over-estiinatioij can be ineasiired before measures of the 
total trait can be looked forward to. 

The road by which we must climb to insight into character 
should not be regarded as a highway to be covered with a 
bound. Quick, quantitative results may establish useful enough 
measuring devises, but may leave us at the end totally ignorant 
of what we measured. 


Summary 

1. Over-estimation, based upon good insight, is a promising 
criterion of Self-assurance. 

2, Tests No. 1 and No. 2 possess advantages for the observa¬ 
tion of tendencies to over-estimate. (But the tests are lengthy 
talcing about 20 to 30 minutes each, with the necessary three 
trials, selection, and then performance.) 

3, Tests No. 1 and No. 2 serve excellently for measure of 
Speed of Decision, ori a significant type of decision—" How 
much can you do?" (Performance iiot necessary in this case, 
hence tests can be given in about 10 minutes each.) 

4. Speed of Decision is probably not indicative of Self- 
assurance. 
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5. Little constancy in speed oi decision on different ma¬ 
terials is manifested. 

6. There is a marked negative relation between Speed and 
Accuracy in the Miinsterberg Decision test. 

7. The classification of specific self-assurances and develop¬ 
ment of separate criteria (rating scales, et al) for each, is a 
suggested future program which may make possible the de¬ 
termination of validity of tests. 

II 

Study of Speed of Decision 

An early study by J. W. Bridges (An Experimental Study 
of Decision Types and their Mental Correlates, Psych, Mon 
XVII, No. 1, 1914), concludes with the following assertions 
regarding speed of decision: 

1. Some subjects are very quick and constant in simple 
situations but are relatively slower and more inconstant when 
decisions are more difficult. 

2. Those quick in subjective decisions are not always quick 
in objective decisions. (Objective are decisions on matters 
quite apparent to sense, like judging which card had more 
holes in it—they would be easily and certainly scored; sub¬ 
jective are decisions on matters of taste and opinion—difficult 
to score.) 

3. In general, practice has no marked effect upon decision 
time. 

In the face of this evidence the use of the two objective 
measuring devices of character which exist ^ definitely implies 
a faith in the constancy of character traits, and of speed of 
decision among them. For when using the scales one gives 
a grade on speed of decision though only one, or at the most, 
two kinds of decision have been measured. 

Thus the common-sense notion of the trait seems to be car¬ 
ried into scientific usage, where it demands further searching 
inquiry. In the case of these scales, it may be that the choice 
of materials has been an exceedingly happy one, and that 
speed of decisions (in the plural) is ‘fairly well represented 
in the results (as is evidently assumed); but this seems by 
no means to have been demonstrated. 

Is speed of decision a trait—a general trait, of which we 
may speak in the singular? Is it a constant and predictable 

1 Reported at the Chicago Meeting of the American Psychological 
Association, 1920. 

(1) A Group Will-temperament Scale, reported by Dr, June Downey. 

(2) Test No. IX, Form 1800, of the Bureau of Personnel Research 
of the Carnegie Institute of Technology, reported by M, J. Ream. 
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characteristic of an individual’s reactions, regardless of the 
nature of the decisions called for? Are there individuals 
who show themselves to be quick in decisions of all kinds? 
Or of many kinds? Or of customary kinds? Are there other 
individuals who excel in one or a few kinds of decision, while 
they prove ordinary or very slow in other kinds ? 

Such, and related, questions must be answered before the 
hope of securing any single representative measure of speed 
of decision can be entertained. 

It was seen that Bridges has given a negative reply to the 
main questions suggested above. His answer, however, may 
be regarded as not decisive, inasmuch as it was arrived at by 
observation of only 19 subjects. It gives only a suggestion 
of the probable nature of the trait in the general population. 

However, the investigation on Self-assurance just reported 
in the foregoing section, disclosed again a condition of lack 
of constancy in the speed of decision of a grovip of 20 persons, 
and more in some cases. None of the time correlations is 
high, .38 being the highest found between any two tests. But 
with this observation and its support of the view in favor of 
a general lack of constancy in speed of decision, the very 
noticeable fact appears that one subject in the group of twenty 
took first rank in speed in as many as three different tests. 
Such a fact discourages the hasty generalization regarding the 
inconstant and unpredictable nature of the trait, Possibly 
larger groups than those tested so far contain more of such 
individuals who distinguish themselves by the possession of 
general superiority, or inferiority, in speed of decision. The 
present investigation is now an attempt to determine the 
strength of this possibility by varying and extending the 
observations. 

The aim is to measure the reactions of a large group of 
individuals to a variety of decision-problems, and to observe 
whether constancy or variation in speed is the rule; to observe 
also if possibly the general rule for the mass hides any signifi¬ 
cant groups of exceptions. 

Description of the Tests 

A brief statement of the instnictions for each test, and 
where possible an illustration of the material, is given here. 
In practice the instructions were read aloud to the subjects, 
and the tests were bound together in the form of a pamphlet. 
No test was seen before signal to start was given, After 
one test was completed all subjects listened while instruc¬ 
tions for the next one were read. So through all six. 
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Test I. 


Test II. 


Test III. 


Test IV. 


Test V. 


Test VI. 


Checlc the one trait in each pair which you possess: 

Patient Impatient 

Cautious Reckless 

Dull Clever 

etc. 

Write in small square below each group the most frequent letter: 

This test has been described in the foregoing section, as 
the Munsterberg Decision Test modified by Sybil Marsh 
Gibson. 

Grade these actions as follows: 


If VERY VERY GOOD.WG 

If VERY GOOD.VG 

If GOOD.G 

If INDIFFERENT.I 

If BAD.B 

If VERY BAD.VB 

If VERY VERY BAD.VVB 


To be an active church member. 

To praise your own cobiting. 

To tip your barber regularly.. 

etc. 

Check the one item in each pair which in your opinion has the 
greater value to the human race'. 


tea kettle.flatiron. 

science.music. 

mirrors.keys. 


Compare each of the figures below with the small square above 

the line. Write an S, L, or E inside of each figure— 

S if smaller than the square in area 
L if larger than the square in area 
E if equal to the square in area 

Which is the greater evil, generally? Check one of each pair. 

Do not skip, but take one pair at a time in order: 

To use cosmetics (paint). To chew gum noticeably in 

public. 

To frequent burlesque. To frequent bull fights. 

To hunt out of season. To be instrumental in re¬ 

instating capital punish¬ 
ment. 

etc. 
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Test I is the Downey test for speed of decision, with a few 
additional traits added to the list. Test II is the M. Decision 
testj modified and transformed from a card sorting test to a 
paper test, but retaining its essential characteristics. Tests 
III, IV, V, and VI are original contributions, though clearly 
patterned after many of the questions and problems that have 
been devised to test moral disposition and appreciation. One 
feels a distinct freedom from the hazardous interpretations 
of the student of moral disposition in employing material of 
this Icind in a manner which disregards the nature of the 
responses given. For here the concern is only speed, and no 
interest is attached to the values of the replies. Of course, 
the subjects taking the tests are instructed in a manner to 
produce careful consideration on their part. Even purely 
hypothetical norms of performance are referred to as actual 
in the instructions in an attempt to make the subjects feel 
the need of careful judgment, and to make accuracy of per¬ 
formance appear the significant consideration in the score, 

The different tests call for a variety of decisions. They 
are planned to bring into play a number of different kinds 
of factors—to stimulate a variety of the typical considerations 
—that tend to make people hesitate when deciding. Test I 
is distinctive in its demand upon self-refercncc, and it invites 
all the difficulties of introspection and the hesitations due to 
modesty in assertion. Test II presents objective, easily veri¬ 
fiable material, but it deprives the subject of the method by 
which he would ordinarily determine liis answer, (He is not 
permitted to count the letters.) The question differentiating 
persons in this test seems to be: "Can I trust the hasty 
impression?” Test V involves decisions of the same objective 
kind, and the same causes for hesitation. 

Tests III, IV, and VI are of a kind in presenting subjec¬ 
tive material for judgment—that is, the decisions are to be 
based on matters of opinion, on social and moral considera¬ 
tions of a high degree of complexity, on personal convictions. 
Test III differs from test VI only in its demand that grades 
be assigned as answers, in place of the mere check on a paired 
comparison. It calls for absolute judgments in contrast to the 
relative judgments of test VI. Test IV has an advantage 
among these tests of so-called subjective decisions in reducing 
the element of speed of reading which possibly affects the 
scores on these tests. 
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Results 

A time limitation was set on the tests, and amount of work 
—number of decisions—scored. 

The number of records obtained was 142, They represent 
the reactions of a very homogeneous group of university stu¬ 
dents, m.ostly under the Junior year in school, though including 
a few advanced students. The records of the latter, however, 
show no noticeable deviation from the rest. 

The time limitations for the various tests were determined 
by prelijuinary trial upon a group of 25 students, and set 
below the fastest performances in that group, the aim being 
to have no persons finish the test. Unfortunately this trial 
group, an evening class in Applied Psychology, did not con¬ 
tain the most speedy performers, and as a result the tests 
were launched out upon the regular class groups with a time 
limitation too lenient. Quite a number of individuals finished 
some of the tests.' This circumstance causes a distortion of 
the distributions of scores which must be referred to later 
when results are interpreted. 

NTERCORRELATIONS OF TEST RESULTS. 142 CASES. FeARSQN PRODUCT 
Moments Formula 

Test Test Test Test Test Test 

I II III IV V VI 


Test 1.43 . 47 . 56 . 31 .51 

Test II.43 ... .51 ,50 , 66 . 32 

Test III.47 .51 .55 .45 .40 

Test IV.56 . 50 . 55 . 57 . 46 

TestV.31 .66 .45 .57 ,37 

Test VI.51 .32 .40 .46 .37 


These coefficients of correlation are not as useful as are 
other summarizations of the results which follow. In the 
first place the distortion of distributions—^the, above-men¬ 
tioned massing of scores at the top of each scale, due to the 
fact that the time allowed for the tests was too great—has 
an influence upon these correlations which is difficult to esti¬ 
mate. It must lower it somewhat, though probably not a 
great deal. In the second place, this influence is not equally 
strong upon each of the correlations in the table, and com¬ 
parisons must be accordingly uncertain. 

If the coefficients are accepted at their face value, or with 
some allowance for the attenuating circumstance, they would 
seem to indicate a degree of constancy in speed of decision. 
Those persons who are quick in decisions of one kind tend to 
be quick also in decisions of quite another kind. The corre¬ 
lations are not high enough, however, to warrant the con- 
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elusion that any one test would serve as a measure of speed 
of decision. This is the important conclusion which may be 
safely drawn from these figures. It seems almost absurdly 
simple as the objective of elaborate investigation, but after all, 
the demonstration serves a good purpose. It is essential to 
the success of character testing that pictures of this Iciiid be 
presented, for without them exalted opinions regarding the 
worth of single tests are apt to prevail. Later figures will 
show how unfortunate would be a classification of persons 
according to score on one or two tests of this trait. 

The two tests which show the highest correlation with one 
another are numbers II and V, the two which have been 
described as objective and as being in that respect similar to 
each other and quite different from the othei-s, Evidently this 
feature is reflected to some extent in the higher correlation. 
It means that a number of the individuals at least show a 
relatively greater constancy in speed in decisions of an objec¬ 
tive nature than in the other types of decision. However, 
another similarity of the two tests, besides their objectivity, 
should be noted, for it may account for the higher correla¬ 
tion. The two tests are, after all, visual perception tests, 
and it is likely that equality of visual endowment, or more 
likely still, equality of practice in gauging by visual impression, 
inay to a large extent determine the correlation. 

The table of intercorrelations shows a still further distinc¬ 
tion between these two objective te.st.s and the others. If 
the averages of tlie columns be taken, with tlic rows II and V 
omitted, the figures resulting are as foflows; 


Test 

Test 

Test 

Test 

Test 

Tc.st 

I 

II 

III 

IV 

V 

VI 

.SIJ 

A4Q 

A73 

.523 

.425 

,456 


These figures show the averages of the correlations of each 
test with all others excepting 11 and V, and it becomes clear 
that tests II and V have the lowest average correlation with 
the rest of the tests. On the whole there is less correlation 
between the speed in objective types of decision and the sub¬ 
jective types than there is between the different subjective 
types here tested. This corroborates one of the observations 
of Bridges, reported at the beginning of this section, 

A further very simple statistical treatment was applied to 
the test results, which yielded returns of considerable value 
for insight, It supplied a means of classifying the individuals 
tested, it presented a more intimate picture of the actual mean¬ 
ing of the correlations (uninfluenced by the disturbing attemvat- 
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ing circumstance), and it allowed a further comparison of 
the tests. The procedure was as follows; On the basis of 
the various distributions the grades in the various tests which 
represented most closely the 20 percentile score and the 80 
percentile score were determined. These served then to dif¬ 
ferentiate the upper and the lower 20% individuals from each 
other and from the middle (60%) group. The choice of the 
20 percentile as the distinguishing level was made after a 
scrutiny of the various distributions of scores. It was found 
by trial that the 80 percentile fell upon an even score in most 
of the tests, that is, definite groups were more regularly 
divided at about this point than at other points (like the 25 
percentile) which were tried. The lower group is really 
marked off by the 23 percentile score. Thus the individuals 
were classified as being either speedy, slow, or ordinary in 
each test. On the score sheet, then, it became a simple matter 
of drawing a circle in black ink about all scores above the 80 
percentile score, and a circle in red ink about those below the 
20 percentile score. A small section of the score sheet is 
reproduced here to illustrate the effect of this procedure, 




Scores 


Subject 

Test 

I 

Test 

11 

© 

Test 

HI 

Test 

IV 

No. 125. 




No. 126.. 

No. 127,. 

S 

13 



No. 128. 

.... L6 

© 


38 

No. 129. 

.... 10 

<0 

© 

37 

No. 130. 

etc. 

... © 

18 


39 


Test Test 

V VI 

20 12 

22 13 



Now to count the number of circles of different color which 
characterize the different individuals becomes au easy matter. 
The following table summarizes the counts, The first column 
shows the number of black circles, that is, the number of tests 
in which the individuals were among the upper 20% for speed ; 
the second column shows the number of individuals who 
attained that status (who had that number of black circles to 
their credit). The third column and the fourth column, re¬ 
spectively show the same facts for the lower 20% (number of 
red circles) as columns one and two. 
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No. of 

No. of 

No. of 

No. of 

tests 

persons high 

tests 

persons low 

6 

6 

6 

2 

5 

2 

5 

6 

4 

6 

4 

10 

3 

10 

3 

16 

2 

21 

2 

20 

1 

30 

1 

27 

0 

66 

0 

58 


0 high and 0 low (middle grade in all tests) 
(widi no circles ot either kind)...12 


This table indicates that 6 persons were in the upper 20% 
of the group of 142 in all 6 tests (like No. 127 in the section of 
the score sheet on the preceding page), 2 persons were in that 
group in 5 of the tests, 6 in 4 tests, 10 in 3 tests, etc.; and 
among the slow indwiduals, 2 were exceedingly slow iit all 
6 tests, 6 in 5 tests, 10 in 4 tests, etc. There were 12 individu¬ 
als who failed to reach either the fast or slow status in a single 
one of the tests, 

Clearly, there are here discovered two groups of individuals, 
and probably really three, to whom the general attribute of 
speed of decision, in some one of its forms as quick, slow, or 
mediocre, may be referred without much danger of inaccuracy. 
The one group of 6 individuals delinitcly possesses the quality 
of quickness in decision, as far as this number of tests gives 
evidence of it. Another group of 2 individuals may be labelled 
slow; and a third group of 12 individuals are characterized 
by constant mediocrity of speed of decision. These distinctly 
recognisable groups comprise 4%, l%,'-and 8%, respectively, 
of. the total number of students tested. 

.The degree to which the poritjons of the less pronounced 
individuals were interchanged from fast to slow and to middle 
groups in the various tests can also be determined readily 
by observation of the circles on the score sheet. A signifi¬ 
cant question which such a determination answers, for instance, 
is the following: Did the two persons who fell below the 
upper 20% in only one test fall way down into the slow group 
in that test? The same question is answered at the same time 
with respect to those who were high in all but two tests, all 
but three tests, etc.; and also the places taken by those who 
were low-in all but one test, all but two tests, etc., can be 
determined. The answers are tabulated in the following man¬ 
ner. The table really constitutes an analysis of the correla¬ 
tions, It shows the fluctuations in position of individuals at 
the various grades or levels of possession of the trait. The 
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first line, if written out completely, would read as follows: 
100% (2 individuals) of the 2 who were high in 5 tests (in 
all but one test) were mediocre in that one test. 

Table Showing Fluctuations in Position 

High Groups. 

100 % high in 5 tests are mediocre in 1 test. 

100 % high in 4 tests are mediocre in 2 tests. 

80 % high in 3 tests are mediocre in 3 ttets. 

10 % high in 3 tests are mediocre in 2 tests; low in 1 test. 

10 % high in 3 tests are mediocre in 1 test; low in 2 tests. 

57 % high in 2 tests are mediocre in 4 tests, 

29 % high in 2 tests are mediocre in 3 tests; low in 1 test. 

14 % high in 2 tests are mediocre in 2 tests; low in 2 tests. 

43.3% high in 1 test are mediocre in 5 tests. 

40 % high in 1 test are mediocre in 4 tests; low in 1 test, 

13.3% high in 1 test are mediocre in 3 tests; low in 2 tests. 

3.3% high in 1 test are mediocre in 2 t^ts; low in 3 tests. 


Low groups. 

100% low in 5 tests are mediocre in 1 test. 

100% low in 4 tests are mediocre in 2 tests. 

94% low in 3 tests arc mediocre in 3 tests. 

6% low in 3 tests are mediocre in 2 tests; high in 1 test. 

60% low in 2 tests are mediocre in 4 tests, 

20% low in 2 tests are mediocre in 3 tests; high in 1 test. 
15% low in 2 tests are mediocre in 2 tests; high in 2 teats. 
5% low in 2 tests are mediocre in 1 test; high in 3 tests. 

30% low in 1 test are mediocre in 5 tests. 

44% low in 1 test are mediocre in 4 tests; high in 1 test. 
22% low in 1 test are mediocre in 3 tests; high in 2 tests, 
4% low in 1 test are mediocre in 2 tests; high in 3 tests. 


This table repeats facts, but it serves to make a few more 
assertions possible. It is really not only the meagre 4% (6 in¬ 
dividuals) at the top of the scale, and the 1% at the bottom 
of the scale, who show constancy of speed in decisions. Inas¬ 
much as the table shows 100% clear from slow decisions in 
both the group of 2 individuals who were high in 5 tests and 
the group of 6 individuals who were high in 4 tests—in the 
first two rows of the table—, it might be regarded as no great 
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distortion of fact to include the Icatter 8 individuals with the 
6 of the upper group who arc characterized by general con¬ 
stancy of speed. This raises the percentage of individuals who 
may be called truly speedy in decision to about 10%. 

On the same considerations the slow group may be extended 
to include two more groups who showed 100% clear from fast 
decisions, and the percentage of truly slow individuals may be 
raised from 1% to about 13%. Furtlier extensions than these 
would certainly not be justified by the facts shown in the table, 

Conclusions 

Correlations between test results are positive and fairly 
high, indicating that individuals who arc quick in decisions 
of one kind tend to'be quick also in decisions of other kinds. 
This does not constitute a demonstration of higli degree of 
constancy of speed of decision, however, as later qualifications 
show. There is little likelihood that any one or two tests can 
be developed to measure the trait adequately. Whether or 
not this small battery of six tests may serve as a fair niea,sure 
is not ascertained, and it remains an inviting inquiry. 

In corroboration of Bridges' observation, to the effect that 
those persons quick in subjective decisions are not always 
quick in objective decisions, it is found that t^c correlations 
between speed in the two objective decisions' atid all others are 
lower than those between any of the other 'smljcctive decisions 
and the rest. Most constancy of speed (the highest correla¬ 
tion) is found between the two objective tests. 

Percentile classification reveals three groups of individuals 
with whom a certain degree of speed of decision seems to be 
constant. The groups are very small, however, By lenient 
extension of classifying boundaries, the group which may he 
regarded as constantly speedy in decision (according to these 
tests) comprises 10% of the total number of students tested, 
8% of the total number are constantly mediocre, and about 
13% show constancy in slow decision. Strictly speaking, only 
4% appear dependably fast, 8% mediocre, and 4% regularly 
slow, 

A general criticism of the group testing situation should 
be added as an interpretation of the results obtained. The 
experience with individual tests of this same trait, with tlie 
tests on Self-assurance reported in the preliminary study, 
served to make the group testing situation appear unsatis¬ 
factory In several respects. The group test introduces an 
uncontrollable and undesirable factor of competition (not 
usual in the deciding-situations of life), and it reduces all 
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tests to a level of similarity to some extent, thus encouraging 
high correlations. 

These two factors are probably more influential in determin¬ 
ing these correlations than would appear to the observer not 
acquainted with the finer advantages of the individual test 
situation. With regard to the factor of competition, very 
clearly the rush to beat one's neighbor, or, disregarding the 
social influence as a disputable item, the rush against time, 
which is undeniably operative, makes of the test a measure of 
something more complicated than its name implies. One's 
decisions under stress of that kind are doubtfully like those 
(in speed) which one ordinarily makes, The instructions, 
the admonitions regarding the^nced of careful judgments, 
which are given to offset the adjustment favoring speed, only 
complicate matters. To the less suggestible and the more 
competitive belong the spoils. 

The particular advantage of the individual test in this respect 
is the possibility of presenting the material in a manner, so 
that the subject may be kept ignorant of a time element in the 
test. Unless the essential feature of natural time-rate of 
decisions is kept in the situation a test cannot very well be 
said to measure natural time-rate of decisions, Yet that, it 
seems, is what we mean when we speak of speed of decision. 

The other disturljing condition in the group testing situation 
is not an inherent obstacle to the success of group tests of 
speed of decision as the other factor is, but it is possible that 
its influence operated to some extent on the results of this 
investigation, For here was an attempt to present under a 
single cover, and in rapid succession, at the same sitting, and 
under the very same conditions of mood and motion, sets of 
problems for decision, whose principal value was supposed 
to lie in their variation from each other. At least, the correla¬ 
tions of the responses were to determine whether decisions of 
a variety of kinds tended to be elicited at relatively constant 
or variable speed from the same individuals. Surely, if the 
situations were identical in some such fundamental respect, 
any characteristic of the separate tests, or of the deciding 
activities responding to the tests, which might favor or incline 
toward variability, would be much reduced in effect. This 
possible influence is mentioned only as a reminder of the very 
doubtful character of the correlations found. They arc not 
high as they stand, but if this similarity of conditions had been 
avoided in some way, so that the true nature of varied deci¬ 
sions had gained expression, it is possible that a greater degree 
of inconstancy would have been demonstrated. 
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Summary 

L Fair positive correlations show some constancy of speed 
of decision. 

2. The difference between objective and subjective deci¬ 
sions is reflected in the correlations. Those persons quick 
in one type are less apt to be quick in the other type than in 
other decisions of the same type. 

3 The large majority (fully 69fo) of individuals tested 
cannot be classified as either quick, slow, or mediocre. They 
are too inconstant. Only 10% may be characterized as quick, 
8% as mediocre, and 13% as slow, according to these tests, 

4. No single test differentiates these relatively constant in¬ 
dividuals from those whose scores fluctuate from extreme to 
extreme in the various tests. 

5. Group tests liave inherent disadvantages for measuring 
this trait, or for improving theoretical insight into its nature. 

Capitulation 

1. Logical analysis of Self-assurance reveals Over-estima¬ 
tion as an element which seems to be particularly amenable to 
experimental test, 

2. Two tests are reported, whicli were tried and found to 
possess certain advantages for observation of tendencies to 
over-estimate. They also provide measures of natural speed 
of decision, 

3. The trait of self-assurance, according to evidence of 
its nature gained by application of a big variety of tests, is 
still too imperfectly defined to enable the adequate testing 
of the tests by definite check against objective criteria. (The 
criteria are not determined.) 

4. Development of a servicable criterion in the form of 
accumulated estimates, to aid which a rating scale was supplied, 
was successful in the matter of securing reliable estimates, 
but complexities of the trait, again, deprive the estimates of 
value as a criterion, Hence 

5. The classification of specific forms of self-assurance and 
development of tests for each separately, is suggested as an 
improvement upon the attempt to deal with the trait in general. 
As criteria, then, either objective and directly measurable 
expressions of the trait may be discovered, or more useful 
estimates will be obtainable—estimates which shall definitely 
bear upon the features which the test seeks to measure, and 
upon these alone, 

6. Speed of decision is probably not a reliable indicator of 
self-assurance. 
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7. Inconstancy in speed of decision is demonstrated to be 
the characteristic of the majority of students tested, Con¬ 
stancy seems clearly to be the exception rather than the rule, 
even under conditions favoring constancy. 

8 . Speed of decision is not likely to be measured by any 
one test or by a few tests, excepting in individuals of proven 
constancy. 

9. Group tests have inherent disadvantages for measuring 
speed of decision, or for improving theoretical insight into 
the nature of the trait. 



PSYCHOLOGICAL NORMS AMONG UNIVERSITY 
FRESHMEN 


By Anna Kellman Whitciiurcji 


This investigation was made at the psychological laboratory 
of Northwestern University during the year 19164917. It 
was undertaken for the purpose of finding whatever correla¬ 
tion may exist 

(1) Between the results in the performance of certain psy¬ 
chological tests, and the mental ability of Freshman students 
as shown in the attainment of grades in Mathematics; 

(2) Between the grades in Mathematics and the ability of 
the Freshmen as shown by the quarter of the High School 
class from which they came; 

(3) Between the grades in Mathematics of the Freshmen 
and their, instructor’s independent judgment of their intelli¬ 
gence. 

Description oj Tests Used in the Present Investigation 

The tests we used were (1) Easy Directions Test/ (2) 
Hard Directions Test/ (3) African Proverb Test, (4) Sub¬ 
stitution Test. 

We used the easy directions test first, and its sections were 
pasted together in such a way that forty continuous directions 
were given. The directions were not numbered, however, as 
they are in the plate. 

The hard directions test followed that. This was given 
exactly as Woodworth and Wells used it. 

The African proverb test was arranged in the laboratory 
of Northwestern University. The object in view was to 
develop a system of simple tests by whicii to gain an insight, 
if possible, into students’ capacities for grasping differences 
and similarities in abstract problems. 

The Substitution test has been used often in one form or 
another. The form devised by W. V. Dearborn and de¬ 
scribed by Whipple, “Manual of Mental and Physical Tests,” 
Part H, p. 136. 

1 Woodworth and Wells Tests No, 88071D, Sloelhing. 

2 Woodworth and Wells Tests No. 88071, SloelUing, 
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Subjects and Method of Investigation 

The Department of Mathematics allowed one hundred 
Freshmen who were taking Mathematics AI to devote the time 
of one class period to the business of taking the tests. They, 
together with a class of sixty Sophomores and Juniors, met 
in a large auditorium, The chairs had desk arms, and each 
student was provided with a lead pencil in order that all con¬ 
ditions of work might be as uniform as possible, Four pro¬ 
fessors from the Department of Psychology, three from the 
Department of Mathematics, and seven members of a Psy¬ 
chology Seminar assisted in giving these tests. 

All the test blanks were marked on the back with a check 
at the top. Those who passed the blanks passed them face 
down but with the check mark in the correct place. As soon 
as the papers were received by the subjects they wrote their 
names and addresses on the back. The papers were left face 
down until all instructions were given. Then the subjects 
were told to grasp the paper at the bottom in such a way 
that it could be conveniently turned. At a given signal the 
papers were turned, and at the word “begin,” the tests were 
started. 

When the time for a test was up, the completed papers 
were passed along the rows of seats to the right. The papers 
for the new test were passed in the same direction, so that 
a minimum amount of time was lost in the mechanics of 
getting the papers collected and passed. This made possible 
the giving of the four tests mentioned above and the following 
tests by another experimenter, in slightly more than an hour’s 
time: two opposites tests, two completion tests, and an in¬ 
formation test. 

With so many helpers the amount of unfair work among 
the subjects was reduced to a small per cent. On the whole, 
we felt that the results were as good as could be gained from 
the ordinary group test. For tlie most part the subjects 
entered into the tests seriously and tried to make them worth 
while. 

The directions for each test were given orally as follows; 

1. Easy Directions Test 

“On the other side of this paper you will find forty simple 
dii-ections to follow. They are like these, I have on the black 
board, 

■' a. Add one dot to the largest group. 

“ b. Write any number smaller than 16. 
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" You are to work as rapidly as possible; for you will have 
only a minute and a half in which to do this test, The test 
is so simple that you will not be likely to make mistakes. How¬ 
ever, work for accuracy as well as speed. Are there any 
questions? Start as soon as you are told to begin, and stop 
immediately when you are told to stop. Ready—turn papers 
—begin.” The stop watch was started at the word ” begin.” 

2. Hard Directions Test 

"This test is like the one you have just finished, save that 
the directions are harder to follow. There are fewer of them, 
and you will have a minute and a half in which to work, as 
you did before, You will be more likely to make mistakes 
here; so pay more attention to accuracy, but work as fast as 
possible. Ready—turn papers—begin.” 

3. Proverb Test 

The following diagram was put on the board; 



English African 


"You will find on this paper two columns of proverbs 
arranged as in this diagrajn—a column of English proverbs 
on the left, and a column of African proverbs on the right. 
The African proverbs are numbered; the English proverbs 
have empty parentheses beside them. You are to turn your 
paper, read the directions at the top and follow them, Work 
carefully; for one mistake will count much against you. Are 
there any questions? Ready—^turn papers—begin,” 

Three and a half minutes were allowed for this. The re¬ 
sults showed that that time was too long; for more than half 
finished the test. This fact will be discussed later. 

4, Substitution Test 

"At the top of this paper you will find nine circles, each con¬ 
taining a number and a symbol. (This was illustrated,) 
Below, you will find two columns of figures of five places 
with five empty squares arranged horizontally beside them. 
You are to write in the squares the symbols corresponding 
to the numbers as given in the circles above. Finish each 
number before you start the next. Finish the first column 
before you start the second. You will have four minutes in 
which to do this. Every thirty seconds I shall say ‘ Mark,’ 
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and you are to put a diagonal mark at the exact place where 
you are then working. This will enable us to find your im¬ 
provement from time to time. Are there any questions ? 
Ready—turn papers—begin.” 

Method of Scoring Tests 

In the Easy Directions Test there are forty directions to 
be followed. The record of speed was made by counting the 
number of directions followed. The accuracy was figured on 
the basis of the number done. 

Number of errors 

-- Acuracy 

Number done 

The Hard Directions Test had approximately twenty-one 
directions, and it was scored in the same way as that used 
for the Easy Directions Test. 

The Proverb Test v/as scored, for speed by counting the 
number done, and accuracy was found, by counting off 12j/^ 
for each proverb placed incorrectly. 

In order to secure the results in speed in the Substitution 
Test, one was counted for every square filled. A record was 
made of what each person accomplished in the eight periods 
of thirty seconds into which die time for the test was divided, 
So few errors occurred that they were negligible. The im¬ 
provement which each person made was found by subtracting 
what was accomplished in the first two periods from what was 
accomplished in the last two. 

The records for all the tests were then placed on cards, one 
card for each individual and his records. An example is given 
on the next page. 

The records for each subject in all the tests were ranked, 
and the rankings placed in red ink above the first records. 
This was done that the Spearman formula might be used in 
correlating the tests. The rankings of each person in each 
test were then added. These results were ranked and formed 
the general intelligence record. Placing the records on cards 
in that way, facilitated the ranking to a great degree, because 
each record was easily moved from place to place. All the 
data, too, for each person was eventually on one card. This 
made the records easy to use and e^y to refer to. 

Specific Errors 

We shall now discuss the errors made in response to the 
four tests respectively. Many of the errors in the Directions 
Tests were due, of course, to hasty reading, 
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Freshman 



Smith, Mary 

Speed 

Accuracy 

Easy D. 


5 

Hard D. 

21 

24 

Proverb 

7 

H 



Improvement 

Substitutian 


147 12 

Combined Ranks 

405.5 



Sample of card used in recording results in tests. Speed = miniber 
of directions finislied, proverbs placed, and squares filled. Accuracy — 
per cent of error in completed work. Imi)roveTnciiL = iU]inber of 
spaces Illlecl in last two periods minus nuraher filled in first two. 
Combined Ranks = rankings in all the tests added together. 

In the Easy Directions Test there were snr])ri.sing']y few 
errors. Thirty-nine people made mistakes, and altogether 
there were fifty-seven errors made, Twenty-six people made 
one error each; ten made two each; two ma<lc three eacli; and 
one made five errors. In speed these people ranked well in 
comparison with the others tested, Those having one error 
ranked from S'/i to 96. The former had completed twenty 
directions and the latter thirty-seven. Tho.se who made two 
errors ranked in speed from 11 to 100. The former had com¬ 
pleted twenty-two directions; the latter had finished all forty. 
Those having three errors ranked from to 3S. The one 
person who made five errors ranked 79^2 in speed. 

The errors taken in order are as follows: 

Ill No. 3, one person placed the number 9 iii.stcacl of 2 
in answer to the question i How msmy ears has a cat ? ” 

In No. 5, instead of a cross, two people merely put a line 

brough the word hat. 

In. No. 6, one person wrote out the word eight, and another 
put figure 8 at the thidc part of the line. 

In No. 7, two people wrote a word of one letter. 

In No. 8, four people put a cross in one of the squares 
instead of a dot; one put a dot in all the squares; one put a 
cross in one, and a dot in another. 
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In No. 9, one person crossed out all the words, 

In No. 11, one person drew a curved line like a hill; another 
connected those given so that a hill was formed. 

In No. 12, six people said there is one t in tmst. 

In No. 13, three people crossed out the undotted line; one 
put a dot in the center; and another dotted and crossed it. 

In No. 14, seven people wrote o above instead of after the 
larger number. 

In No. 18, one person crossed out the middle square. 

In No. 19, one person put a larger number instead of a 
smaller one after 10. 

In No, 21, one person underlined the g. 

In No. 22, one person wrote 2 above the dots; one put a 
dot between. 

In No. 23, two people said 12 feet make a yard. 

In No, 25, one person put a dot above the line. 

In No. 26, two people multiplied instead of adding the num¬ 
bers ; one simply rewrote them. 

In No. 27, one person rewrote the whole word John. 

In No, 28, four'people dotted the circle. 

In No. 29, one person wrote F, and another wrote C. 

In No. 32, one person crossed out the egg-shaped figure. 

In No. 33, two people made only one dot. 

In No, 35, two wrote N instead of e. 

Some of these errors are alike and may be accounted for. 
The errors in No. 5, where the lines were drawn instead of 
crosses made, were probably due to the fact that the direction 
just preceding called for a line to be drawn. Then, in No. 8, 
where five people put a cross in the white square, the error 
was probably made because a cross had been asked for just 
previously in No. 5, while no dots as yet had been called for. 
The largest number of errors made in any one direction 
occurred in No. 14, where seven people put the 0 above instead 
of after 86. This was probably because in the preceding 
direction they were asked to put a dot above the line. In 
No. 28, four people put a dot instead of a cross in the circle. 
This undoubtedly was due to the fact that in No. 22 and 
No. 25 dots had been called for. In No. 32, one person put 
a cross in the egg shaj^ed figure, probably because No. 31 
had called for a cross. 

These errors seem to show the influence of the preceding 
actions. The memory seems to have been carried over and 
to have inhibited the new reaction. 

In the Hard Directions Test sixty-two people made errors; 
and one hundred and twenty errors were made altogether, 
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Thirty-four people made one error each; ten made two; 
nine made three; seven made four; one made five; and one 
made six, The rankings in speed of those making one error 
ranged from 4 to 89^. Those making two errors ranged 
from 4 to 89^. Those having four ranked from 7 to 89J^. 
The one having five ranked 89}4, and the one having six had 
that ranking also. 

The errors in each direction were as follows: 

In No, 1, two errors were made. One person drew a line 
above one letter, and another dotted all of them. 

In No. 3, two people said Christinas comes in Marcli. 

In No. 4, fourteen answered correctly, but in answer to No. 
5 ten of them crossed out their answers, showing that the next 
direction was incorrectly followed. One wrote nothing, and 
one said the sun rose in the west. 

In No. 6, fourteen said a horse has two feet; one left the 
space blank. 

In No. 7, three wrote, “ NO.” 

In No. 10, thirteen left this blank, and one wrote, '‘Yes.” 

In No. 8, three gave the correct number of days. 

In No. 11, four left this blank. 

In No. 13, five made a square, and one made a cross. 

In No, 14, one person made two crosses, and one made one. 

In No. 15, one wrote 6; one wrote HX)0; one wrote 1076; 
two left it blank. 

Six people left No. 16 blank. 

Eight said that nights in suininer were longer than in 
winter. 

In No. 19, one answered incorrectly. 

Two wrote 12 in No. 20. 

In No. 21, sixteen people wrote the letters in the wrong 
place or else wrote the wrong letters. 

The mistakes in this test were due clearly to misreading and 
confusion. There is nothing about the errors made to show 
that the effects of one process are carried over to the next. 

In the Proverb Test, forty-one people made errors, and 
eighty-four errors’ were made. Twelve people made one error 
each; nineteen made two; six made three; and four made four. 

Those who made one error ranked from 3)4 to 62 in speed. 
Those who made two mistakes ranked from 1 to 62. Those 
who made three errors ranked from 19^ to 62; while those 
making four also ranked from 19j4 to 62. 

In No, 1, no one made an error. 

In No. 2, seventeen errors were made. No. 5 of the Afri¬ 
can Proverbs was given for its equivalent in meaning six 
times; No, 2 was given eight times; No. 7 once, and No. 3 
twice. 
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In No. 3, four errors were made. No. 2 of the African 
Proverbs was given for its equivalent three times; No. 3 was 
given once. 

In No. 4, sixteen errors were made, No. 4 of the African 
Proverbs was placed here seven times; No. 6 five times; No. 

1 twice; No. 3 once. 

In No. 5, fifteen errors were made. No. 3 of the African 
Proverbs was given as its equivalent nine times; No. 5 three 
times; No. 6 once; No, 4 once; No. 2 once. 

In No, 6, seven errors were made. No. 6 of the African 
Proverbs was given as its equivalent twice; No. 3 twice; No, 
7 twice; No, 4 once. 

In No. 7, there were eleven errors. No. 1 of the African 
Proverbs was given as its equivalent four times; No, 3 four 
times; No. 5 once; No. 2 once, and No. 6 once, 

In No. 8, fourteen errors were made. No. 7 of the African 
Proverbs was given as its equivalent eleven times; No. 2 once; 
No. 5 once; No. 4 once. 

No. 3 of the African Proverbs was misplaced nineteen 
times. No. 7 was misplaced fourteen times. 

In the Substitution Test few errors were made, Three 
people did not mark the thirty-second periods as the signals 
were given, One person worked across the page instead of 
down the first column and then down the next.' 

The Spearman Foot-Rule Formula was used to obtain the 
correlations, The formula is 

6SG 

R = 1- 

N*—1 

R stands for index of Correlation. 

2 G stands for the sum of the numerical gain in rank of 
the individuals in the .seconds, as compared with the first 
series of the results which were correlated, 

N stands for the number of individuals in the series, 

The 4 was obtained by the use of Thorndike's table, which 
converts R into the Product-Moment equivalent r. Thorn¬ 
dike’s formula for so converting R is 

r = 2 cos—(I'R) — 1 

3 

Following are the correlations between the results of the 
various tests: 
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Easy Directions and Hard Directions (Speed).70 

" '* '■ •* " (Accuracy).33 

Easy Directions and Proverb (Speed).42 

“ “ '■ “ (Accuracy).33 

" " " Substitution (Speed).52 

Easy Directions (Accuracy) and Substitution (Impiovcmcnt).36 

Hard Directions and Proverb (Speed).36 

" " “ “ (Accuracy).36 

" " “ Substitution (Speed).36 

Hard Directions (Accuracy) and Substitution (Improvement).00 

Proverb and Substitution (Speed).32 

Proverb (Speed) and Substitution (Improvement).25 

General Intelligence and Easy Directions (Speed).71 

“ “ “ » (Accuracy).32 

" “ Hard ■' (Speed).72 

“ “ •' " *' (Accuracy).32 

" " " Proverb (Speed) ..54 

*' " “ “ (Accuracy).55 

■* " *' Substitution (Speed).48 

" “ '* (Improvement).44 


Estmated Abilities 

We obtained an estimate of the natural ability of each stu¬ 
dent from the Professors in Mathematics who had under their 
instruction the Freshmen who had been tested. The followiiig 
instructions were guen to them; 

So far as you are acquainted with the following |)crsons, 
mark down after each name a number indicating the intel¬ 
lectual fitness of each individual. Grade in terms of what 
you consider their real ability or capacity to do difficult intel¬ 
lectual work—not in terms of their customary class per¬ 
formances, 

Mark -f 2 after superior individuals 
“ +1 “ very good “ 

" 0 “ merely average ’* 

" —1 “ just below “ 

“ =2 “ very poor “ 

In that way an estimate of the ability of all hut four ot the 
hundred was obtained. Each professor was asked to make 
as nearly as possible a distribution corresponding to the fol¬ 
lowing: Out of ten pupils, four would rank at zero, two at -1-1, 
one at ~{-2, two at —1, and one at —2. The professors’ esti¬ 
mates are shown in Table I, pp. 328-329. 

From the high schools where these students had graduated, 
we learned whether these people had been in the first, second, 
third or lowest quarter of their class at the time of gradua¬ 
tion, We obtained the desired information from all but seven¬ 
teen high schools. The other ranic.s are given in the third 
column of Table I. 




























PSYCHOLOGICAL NORMS AMONG UNIVERSITY FRESHMEN 327 


Arrmigement of Results in Table 

The group oE one hundred Freshmen was divided into four 
quarters. The results of the tests were arranged iii'order of 
attainment when all the ranks of each student in the tests were 
added together. These are given in Column 1, Table I, Thus 
the first quarter has the twenty-five who did the best work 
in the tests; the next quarter has those who came next to them; 
the third and fourth quarters are arranged accordingly. The 
next column, No, 2, contains the estimates of the professors 
Upon the abilities of the students in question, In the next 
column, No, 3 are their respective positions in the high school 
class with which they graduated. In the last column, No. 4, 
are the grades obtained in Mathematics. These grades were 
given in terms of A, B, C, D, F,—A being the highest pos¬ 
sible grade, and F denoting failure in the subject. For con¬ 
venience's sake, these grades are given in the table as 1, 2, 
3, 4, 5,—1=A, 2=B, etc. 

The following correlations were made between General In¬ 
telligence as found in the combined results of the tests, the 
grades in Mathematics, the estimates of ability by the pro¬ 
fessors, and the quarter of the high school class in which they 
were placed; 

General Intelligence and Mathematics’Grade = ,24 
“ " " Professor’s Estimate = .22 

“ “ “ High School Quarter = .36 

Mathematics Grade “ " " "- = ,55 

" " " Professor's Estimate =:= .92 

Professor’s Estimate “ High School Quarter = .59 

The following table is divided into four quarters accord¬ 
ing to the respective rankings in the tests. The second column 
gives the professor's estimates; the third gives the High School 
Quarter from which the students came; the fourth gives the 
Mathematics grades. 
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1 

2 

3 

4 
6 
6 
7 
6 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 

25 


Sum of 
Ranks 
In Tests 
614 
597 
572 
567 
558 
557 

533.5 
528 
526 

525.5 
525 

523.5 

521.5 
520 

517.5 
514 
511 

510.5 

504.5 

503.5 
503.5 
496 
496 
493 
488 


TABLE I 
First Quarter 
Prof. Est. Tcmisof 

+2,+1,0, H. S. 
—li —2 Quarter 

+2 1 

+1 1 

+1 1 

+1 3 

+2 1 

+1 1 

—1 1 

+2 1 

+1 1 

0 4 

+2 1 

+1 1 

+1 

—1 1 

—2 4 

+1 1 

0 

—2 2 

0 1 

=i 


26 

27 

28 

29 

30 

31 

32 

33 

34 

35 

36 

37 

38 

39 

40 

41 

42 

43 

44 

45 

46 

47 
4B 

49 

50 


Sum of 
Ranks 
In Tests 
483.5 

483.5 

480.5 
480 

477.5 
472 

467.5 
462 

461.5 

461.5 
461 

458.5 
453 

450.5 

440.5 
440 

435.5 
427 
425 

423.5 
422 

421.5 

415.5 

414.5 

412.5 


Second Quarter 
Prof. Est. Termsof 

+2, +1, 0, H, S. 
——2 Quarter 

+ 1 1 


"6 

+1 

0 

0 

0 

—1 

0 

—2 

0 

+2 

— 1 
+1 
0 
0 

—2 

+1 

—2 

0 

—2 

0 

+1 
— 1 
0 


2 

4 

2 

1 

1 

2 

1 

4 

2 

4 

1 

1 

3 

2 

1 

1 

2 

3 
1 

4 
1 


Math. 

Grades 

1 

1 

2 

4 

1 

2 

4 
1 
2 
3 
1 
2 
2 
3 
2 
2 

5 
3 
3 
5 

3 
5 

4 

3 


Math. 

Grades 

2 

2 

1 

4 

2 

3 

4 
3 

5 
1 
1 
5 
2 

3 
2 
5 
2 

4 

3 

4 
2 
2 

5 
3 
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Sum of 
Ranks 

TABI,E I—Con. 
Third Quarter 
Prof. Est.jTermaof 
+2. +1. 0. 

H. S, 

Math. 


In Tests 

—1, —2 Quarter 

Grades 

51 

412.5 

0 

1 

3 

52 

408.5 

0 

2 

3 

53 

403 

+1 

1 

2 

54 

403 

0 

4 

3 

55 

401 

—1 

1 

3 

56 

396.5 

0 

3 

3 

57 

395 

—1 


4 

58 

395 

0 

i 

3 

59 

394.5 

—1 

2 

4 

60 

388 

+2 

1 

1 

61 

380.5 

+2 

1 

1 

62 

377 

0 


3 

63 

374.5 

+1 

i 

3 

64 

368 

0 

2 

3 

65 

367.5 

—2 

4 

5 

66 

367 

+1 

1 

2 

67 

365.5 

+1 

2 

2 

68 

364 

+1 

2 

3 

69 

356.5 

0 

2 

3 

70 

345- 



. 

71 

340 

— i 

3 

4 

72 

338,5 

+1 

1 

2 

73 

332 

—2 

4 

3 

74 

332 

+1 

1 

2 

75 

331 

0 


3 


Sum of 
Ranks 

Fourth Quarter 
P rof-IEst. Termsof 
+2,+1,0, 

H. S. 

Math. 


In Tests 

—1, —2 

Quarter 

Grades 

76 

324.5 

+1 

1 

2 

77 

324.5 

+2 

1 

1 

78 

318.5 

—1 

3 

5 

79 

318.5 

+1 

2 

2 

80 

313 

+1 

2 

1 

81 

311 

0 

1 

3 

82 

310 

+1 


3 

83 

303 

—1 

i 

4 

84 

293.4 

+1 

1 

3 

85 

291 

+1 

4 

2 

86 

284 

—1 

3 

5 

87 

283 



• 

88 

275 

+2 

1 

1 

4 

89 

269.5 

+1 

1 

1 

90 

91 

262.5 

245.5 

—1 

—2 

i 

b 

5 

92 

93 

240.5 

238 

—2 

0 

3 

b 

3 

c 

94 

238 

—1 

1 

b 

o 

95 

203.5 

0 

1 

3 

o 

96 

201.5 

0 

1 

o 

97 

196.5 

+1 

2 

3 

o 

98 

184 5 

+1 

3 

c 

99 

161 

—2 

'4 

D 

e 

100 

144.5 

—2 

4 

O 
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In order to see, li possible, the difference in mental ability 
between those who ranked highest and those who ranked 
lowest in the tests, it was decided, that three from the top 
and three from the bottom shovild be tested individually. 
Results for only two at the bottom were ohtaivied, The tests 
used for this purpose were; Healy Puzzle Box; The Dutch 
Homestead (test for memory of ideas from Whipple’s Man¬ 
ual) ; a Part-Whole and a Genus-Species test. 

The next table shows the results obtained. The mimbcis 
in the first column correspond to those in the first column 
of the quartiles in Table I. 

The column entitled "Steps” under the Healy Puzzle Box 
Test shows the nuiiiber of steps necessary to open the box. 
A perfect performance is six. Under “ Time,” the number 
of minutes and seconds required are shown, 

The columns devoted to the Dutch Homestead show the 
number of words and ideas recalled. In the test there are 
one hundred and eighty words and ninety-four ideas. The 
median reaction time is given for the Part-Whole and Genus- 
Species tests. 


TABLE No. 11 

Part-Whole Genus-Species 
Healy Dutch Median Median 

Puzzle Box Homestead Reaction Reaction 


Time= TLme= 



Steps 

Time 

Words 

Ideas 

Seconds 

Seconds 

1. 

23 

5'57" 

159 

47 

2.2 

2.3 

2 . 

10 

2' 31* 

94 

25 

2.6 

1.6 

3. 

17 

3' 50’ 

67 

27 

2.7 

2.2 

98. 

0 

P54‘' 

135 

32 

3,3 

4.25 

100, 

17 

4' 42' 

106 

27 

2.0 

2.5 


The results from the above do not correspond with the 
results of the first set given. For instance, the man who was 
number 98 in the first series used the fewest steps and least 
time in opening the Puzzle Box. As the least possible num¬ 
ber of steps is six, his performance was almost perfect. 

In the Dutch Plomestead test the girls wlio ranked first 
in the other tests were superior. The other four are nearly 
alike in the number of ideas remembered, while in the niimbei 
of words given the two lowest are distinctly better. 

The reaction times in the Part-Whole test vary but little. 
In the Genus-Species test, practically the only variation is 
between Number' 2 and Number 98. 
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The result hoped for was not obtained. These last four 
tests show little if any difference between those who ranU 
high in the first tests and those who rank near the bottom 

Introspective Data from Tests 

There has been, up to this time, too little discussion of the 
mental capacities or functions that are most active when one 
is reacting to the tests in which we are interested. There 
is too little description, too, of methods by which different 
reactors go about their work. This data can be obtained 
in part by introspection. This is important because before 
a test can be evaluated it is necessary to obtain all the infor¬ 
mation possible about it. 

With this in mind, one day around the seminar table, eight 
people, six advanced students and two professors in psy¬ 
chology, took the tests we had given to the Freshmen. After¬ 
ward each one recorded his mental processes while talcing the 
test, These people were experienced in introspection, and it 
was hoped that we might find some of the frequent ways in 
which those people tested ordinarily went about their work, 
and the various mental processes used in doing the tests. 

The following arc some quotations showing various inter¬ 
esting ways of proceeding with the test material. The first 
are from the Easy Directions Test. 

“ I had a feeling of pushing from within or of an effort 
to get ahead in a short space of time. There was also a 
fceliiig of checking myself lest I should omit a line or make 
another error. My attention was directed rather narrowly 
to the directions thonselves." 

The method just quoted is one probably used by many 
people, The feeling of push would be prevalent in most tests 
where speed was involved. The next person went about the 
test in a different way. 

" I read rapidly. I did not pronounce all the words, and 
I am not sure that I even saw them all. I was conscious of 
trying to understand the direction, and a feeling of surety 
and satisfaction came with the grasp of meaning. After 
the meaning came, I waited with gaze fixated on the symbols 
at the end, and the proper movement of the pencil resulted 
automatically, When the feeling of meaning failed to come, 
I con.scioasly repealed parts of the direction or even the whole 
thing over again. There was consciousness of strain 
thronghoLit,'’ 

The two people quoted seem to represent two groups often 
seen in Mathematics classes. The one is careful and method- 
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ical aiK[ sure. The other breathlessly grasps an indefinite 
meaning and automatically works a problem by tiie fir.st method 
that comes to mind. He works more rapidly than the first, 
and though he may make more mislakcs, will accomplish 
as much in the end because of his speed. 

In regard to mental processes, the* following statements 
were made: 

“The test seems to call for readiness in recalling alterna¬ 
tives, The presence or absence of hesitancy would soon be 
felt.” 

"The requirements seemed simple enough until No, 7 was 
reached. This called for a word of three letters, and I felt 
like checking myself to see which word might be selected, 
In No. 11, where we were asked to mark the line which looks 
most like a hill, I wondered that any of them appeared like 
a hill. My next notion was tliat the turning of the [)aper 
might make one of them into a hill. I finally chose the third 
as the one being most appropriate when the paper was in 
its natural position." 

"The figures on the right received the most passive atten¬ 
tion except in the cases of No. 6 and No. 11, where I had 
to discriminate between stimuli. In No. Ill wa.s puzzled. 
In no other case did I cousciousiy discriminate. It seems to 
me that the predominant function here is voluntary attention 
to immediate sensory stimuli.” 

"No. 10 called for voliuitary inhibition. No.s. 1, 2, 4, 6, 8, 
11, 13, 16 and 18 called for appreciation of objects. Nbs. 5, 
6, 14, 15, 19, called for comparison of values. Nos, 3, 7, and 
12 called in association. No. 9 required general memory,” 

All of the above quotations seem to show the required use 
of attention and apperception. Probably more than any other 
one thing, this Easy Directions Test does test the function 
of attention, 

Some remarks in regard to the Hard Directions Test follow: 

" The words of the instructions continued to sound audi- 
torily-Icinaesthctically while the answers were being written, 
They seemed to determine the proper answers. Occasionally 
I started to make the wrong answers. Immediately an un¬ 
comfortable feeling arose. Pertinent parts of the instruc¬ 
tions became more vivid auditorily. With the right answer 
came a feeling of relief." 

“Here I had to keep attention not only on what was pass¬ 
ing under my eye, but usually upon what had preceded; and 
not only that, but I was always In an attitude of expectance 
also—i. e,, toward the future. Consequently I was embarrassed 
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always by alternating attention between the directions, and 
I was all the more fearful of making mistakes. There was a 
feeling of greater effort here than in the Easy Directions 
Test, where I attended only to what was passing under my 
eye.” 

” This test required perpetual attention. A perceptioh or¬ 
ganized into a very definite appreciation or appeiception of 
what was wanted in each case was necessary. This was dif¬ 
ferent from the easy test and noticeably more difficult in that 
a constant resistance to suggestion was required throiighoat. 
Imagination seemed to play no part here. Memory was not 
so much involved since the facts called for were of a triflingly 
common nature. But power to command this knowledge in¬ 
stantly and without forewarning and to write it as quickly 
as it was thought was needed.” 

" Reasoning was most used in this test, as many times rea¬ 
soning compelled me to do the opposite from what memory 
suggested as being correct for certain of the questions, All 
the time I felt that I would have to be careful lest the sim¬ 
plicity of the questions as asked would lead me to erroneous 
answers. The feeling of caution was present,” 

” There was present inhibition to respond in the usual way. 
This sometimes in the first reading led to closer attention. 
Often I tended to the wrong answer, but stopped to compare 
my knowledge with the suggestion made on the paper,” 

At once we wonder what the effect of the various reactions 
called forth in individual subjects would have upon the speed 
and accuracy of their performance. In the Easy Directions 
Test the close attention which was mentioned several times 
would surely lead to accuracy, and would probably steady the 
rate of work. In the case of the man who waited automati¬ 
cally for the answer to come to his pencil, one might suppose 
the process of answering to have been subconsciously done. 
While this might accelerate speed, it would be apt to block 
accuracy. 

In the Hard Directions Test, the subject who held his 
attention closely to the direction upon which he was working, 
to the one preceding that, while consciously alert for the one 
about to conie, probably made no mistakes, and his s])eed 
would be greater than the one who read carelessly and hur¬ 
riedly and so had to go back. The fact that answers were 
called for contrary to one’s usual line of thought would de¬ 
crease speed and lay one liable to errors. The constant alei't- 
ness and caution necessary to overcome that would make for 
accuracy, but would probably decrease speed. In short, any- 
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thing purely automatic could be very rapidly accomplished. 
Those directions calling for caution, reason and discrimination 
would cause delay. 

To proceed to the Proverb Test; 

“My consciousness of ihc directions seemed to be suiniticd 
up in a visual kiiiaesthetic leeliiig of putting miinljers in 
brackets, 1 read through an English pvovcrl) without getting 
a clear comprehension of its meaning—i. e., I did not translate 
it into other terms or apply it mentally to any concrete situa¬ 
tion. Nevertheless, I proceeded immediately to glance hastily 
through the African proverbs. I rushed up and down the list 
in great haste withoiil: attempting to read one of them through, 
and without system, until I struck a phrase or turn of words 
that ' felt right.’ Then I automatically put the number in the 
brackets, The consciousness of agreement between the mean¬ 
ings was a vague process.” 

Another wrote, “ The first time I undertook this lest I was 
embarrassed by the Directions. The nature of the test bad 
not been adequately explained to me. I wanted to make 
speed, blit I had to look into the proverb.s to understand the 
directions. Then the truth flashed over liie, that I was adding 
time to my record. I was embarra.ssed, and because of that 
I started under a handicap. When I was ready to go at the 
work I followed this method; I fixed the first Eiigli.sh Proverb 
in mind, and then read through the African proverbs com¬ 
paring each with the meaning of the English proverb. After 
selecting one fitting its meaning, 1 proceeded the same way 
in eacli other case. In each case the proverb suggested a 
visual image, and I found myself looking for a cominon or 
near common element in these images and comparing them. 
When once I was ready to write the desired numbers beside 
the English proverbs I had the feeling of having solved a 
problem. The ability called for here seems to be that of 
handling imagery more or less abstract.” 

One student used the method described above, but instead 
of reading an English proverb first, he selected an African 
proverb and searched for one of like meaning in the English 
column. After describing his method he says; “But with 
many of the African proverbs 1 felt that the meanings were 
too ambiguous ever to admit of close comparison. Continued 
thinking and reasoning led me to believe that I had stressed 
the details too much, and that I should select that larger 
meaning of each proverb and adhere to that for comparative 
purposes.” 
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Another says: " The process is one oi comparison analagous 
to that of superposition in geometry. Superposition here is 
one of ideas rather than symbols. Selection of the correct 
parallel proverb is a matter of assembling all the African ones 
not yet used as possibilities. Next, the irrelevant ones must 
be rejected. In carrying on the process of selection, the one 
proverb has to be borne in mind as the problem or end in 
view,” 

Here again we have two types of individuals, the one who 
hastened to read here and there in the two columns, and the 
one who conscientiously and carefully read and compared one 
proverb with the others. In the fi,nal results one type did as 
well as the other, It would seem from the descriptions we 
received that much the same process was carried on as that 
used in solving a problem in mathematics. It was necessary 
first to analyze a proverb and retain its abstract meaning. 
Comparison of one abstract meaning with another was neces¬ 
sary all the way through. The final selection would ade¬ 
quately compare to the solution of a problem. The mind 
acting accurately in this situation would doubtless do equally 
well with a mathematics problem. 

Some of the remarks on the Substitution Tc.st follow: 

"The feeling that I should need to remember the symbols 
later led me to try to impress them upon my mind. It was 
soon found to be economical to try to memorize the easiei 
symbols. An association helped in fixing the symbols. For 
instance, I thought of 7 as A incomplete and np-side-down,” 

Another says he made no conscious effort to remember. 
He simply relieved memory of that strain and allowed a 
habit to form. Fle had to inhibit the desire to place one 
symbol for another that had just been used, 

A unique way of doing the test is described here: “The 
first time I tried this test I did not play the rules of the game, 
but read the number, held the digits in my mind’s eye and 
then hunted for the necessary symbols in succession. These 
symbols I was .soon able to write in the squares without look¬ 
ing at the squares. No attempt was made to learn the symbols, 
and they were not learned at all well. I had their location 
in mind much as a typist has in mind the location of the keys. 
Primary memory for the numbers seems to be the only mental 
function I employed. Later I found the real learning of the 
symbols more difficult. Primary memory for the whole " key 
board ” was finally aaiuired, largely by aid of imaginary asso¬ 
ciation in which I imagined houses, trees, etc., in a yard stand¬ 
ing for the symbols respectively.” 
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The way this man did the test the first time may have been 
duplicated by members of the Freshman group who were 
tested. In that case accuracy would be perfect, and speed 
■would range high. The test would not he one of learning 
at all, It would test rather primary memory and motor 
facility, 

The next person made it a real learning test, He says: 

“ I kept my eyes on the key as much as pos.siblc and filled in 
the spaces withoLiC looking. I read each individual digit 
separately and then looked at the key. At first it was neces¬ 
sary to hunt consciously for digits in the key. Gradually the 
proper digit with its symbol would tend to jump out from 
the key as a whole; i. e,, I would tend to turn directly to 
the proper place in the key. Occasionally when I got lost I 
hunted up and clown the key board without taking in imicli 
of it. As learning progressed, the symbols for the different 
numbers became consciously recognized and identified when 
found, The ability to find them quickly seemed to be corre¬ 
lated with this fact that the symbols were getting learned.” 

One student said: "The power to form visual images 
rapidly and accurately seemed to conic into play, After 
writing two numbers, it became easier to ‘ .See ’ the proper 
symbol mentally as soon as the digit was read than to look 
back to the heading. To people whose memory images are 
other than visual, I believe this would be u difficult test, and 
could be done only slowly.^’ 

As in this case, visual imagery would assist greatly in the 
test, but motor imagery might be quite as adequate. 

From this introspective data we find the predominant men¬ 
tal functions used in these tests to he: active attention, 
response to immediate sensory stimuli, discrimination, com¬ 
parison and selection, and association. Looking back at niy 
own experience in mathematics, I would say that these func¬ 
tions played a large part in solving probleihs. It is necessary 
to center one’s attention to analyze and to discriminate in 
order to come to a solution, 

Professor Frank Nugent Freeman in his “Psychology of 
the Common Branches '* tells us that problems are solved by 
analyzing conditions and -following up clues. Before the 
solution can be obtained it is necessary to get an understanding 
of the problem in concrete terras. In geometry, for instance, 
a pupil must thoroughly understand that the lines and angle.? 
represent real spacial relations. 

This analysis and following up of clues is apj^avent in the 
Directions Tests and the Proverb Test. So far as we can 
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rely upon the introspective data, it would seem that these 
tests tested the same ability as that which Professor Freeman 
feels is required by the student in Mathematics. 

Disatssion of Results 

The data gained from those who took the tests for the pur¬ 
pose of introspection seem to show that the tests really tested 
some of the abilities necessary for successful work in Mathe¬ 
matics. However, the correlation between the results of the 
tests and the Mathematics grades is low (.24). This may be 
due to poor adjustment of the students to their work during 
the first semester of their University course, or it may be 
that the introspections did not reveal the real abilities tested. 
If the latter is true, then the tests selected may not test the 
abilities necessary in work in Mathematics. 

On the other hand, it is quite possible that the students 
tested did not put all of their energy into the tests, and there¬ 
fore did not do them as well as they might have done, It is 
impossible to tell just how much attention the subjects did 
give their work. While they appeared to work hard during 
each test, they undoubtedly did not put in their maximum 
attention, Indeed, it is impossible to measure the absolute 
degree of attention by any laboratory methods at present per¬ 
fected. This inability to measure attention is a drawback in 
every phase of laboratory psychology. Granting that the stu¬ 
dents did not do their best in these tests, while the tests might 
liave got at mathematical ability, the results would not show 
high correlation. 

Three Professors graded the students upoji their work in 
Mathematics. It is unlikely that all three of these have the 
same standards of grading. Therefore, the grades them¬ 
selves with which these correlations were made are more or 
less arbitrary. 

Then, again, the tests given individually to those who stand 
highest and those who stand lowest do not show a very great 
difference. It is well known that high correlations are not 
to be expected from a homogeneous group of subjects. Either 
part do well in those things, in which others fail, or all fail 
and succeed in the same lines, and thus balance the results. 
This causes the results of the group to fall into a narrow 
distribution. Our group of subjects were all Freshmen, This 
pre-supposes a degree of homogeneity. The subjects have all 
passed the same entrance requirements to begin with. By 
referring to Table I it will be seen that forty-five of the one 
hundred are from the first quarter of the high school class 
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with which they graduated. Granting that some of these 
classes were small, and that the quarter in which each student 
was placed was assigned more or less arbitrarily by the prin^ 
cipals of the high schools, still the fact remains that forty-five 
per cent of these students were considered considerably better 
than the average in their classes. This fact of the hornogeneity 
of the group would account for a relatively low degree of 
correlation, 

The high correlation (.92) between the grades in Mathe¬ 
matics and the professor's estimates of the students’ abilities 
were to be expected. The grades received by the students 
probably influenced the professors when they gave the esti¬ 
mate, and vice versa. 

The correlation between the grades in Mathematics and the 
high school quarters from which the students came was .55. 
This was as high as could be expected when we remember 
that forty-five per cent came from the first quarter. 

On the whole, this investigation seems to have been worth 
while in spite of the fact that the results in the mental tests 
did not correlate highly with the Mathematics grades. The 
student who did the best work in the tests was found to be 
an exceptional student. She received A grades in all her 
work for the first semester. The student who stood lowest 
in the first tests failed in all his work. He failed twice in 
Mathematics, and, after having been tutored privately, failed 
the third time. Even with the unavoidable difficulties that 
come up in getting accurate results from mental tests, it would 
be possible for a teacher to gain some insight into his students' 
abilities by the use of such tests at the beginning of a semester’s 
work together. This investigation shows a more or less 
definite connection between the class standing and abilities 
involved in doing the tests. 

Dr, Wissler^ who made correlations with some of the test¬ 
ing done at Columbia University, felt that the markings in 
college classes would correlate with mental tests to only a 
slight degree, Miss Calfee's* correlations between the tests 
she gave at the University of Texas and the average class 
standing were low. Professor Bell* in* his work at the same 
University found his highest correlation between a class stand¬ 
ing and the results of a test to be only ,31. Miss Rowland 
and Miss Lowden'’ found a correlation of ,25 between grades 

^ Psych, Rev Mono. Sup. 3, 1901, No. 6. 

*J. 'of Ed. Psych. 4. 1913, 223-231. 
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ill Mathematics and one gi'oup of tests. While the results 
recorded here arc much like those we found with our work 
with Northwestern University Freshmen, still we feel that 
there is a hopeful outlook.. With perfection of methods of 
giving mental tests, and perfection of a system of grading 
for class work, the connection between the two will be more 
evident. When that time comes, the results of mental tests 
will he an index to the abilities of students in their class work. 

1. The highest correlation iiuthis investigation was .92. 
This was between the professor's estimates of the students’ 
ability and their grades in Mathematics. 

2, The lowest correlation was .0. This occurred between 
the accuracy in the Hard Directions Test and the improve¬ 
ment in the Substitution Test. 

3. Among the tests the correlations ranged from .72 between 
General Intelligence and Hard Directions Test to .0 between 
the accuracy in ibc Hard Directions Test and the improve¬ 
ment in the Substitution Test, 

4, The correlations with the Mathematics grades were: 

Matheniatics and General Intelligence.24 

Mathematics and High School Quarter.55 

Mathematics and Professors* Estimates. .. .92 



A PRELIMINARY REPORT OF AN EXPERIMENTAL 
ANALYSIS OF CAUSES OF STUTTERING^ 


By Lewis 0, Andehsoh, University of Wisconsin 


Of human afflictions, stuttering is one of the most elusive. 
Persons who are handicapped by it often find no one who 
can give intelligent advice or tveatmeiit. Many , become vic¬ 
tims of quacks. Moreover, if we look to various recognized 
authorities on stuttering we find great diversity in the theories 
which have been put forward. Repressed “ complexes ” have 
been held responsible. Weak imagery has been assumed. The 
trouble has, in general, been looked upon as mental, but there 
has also been belief in some defect of physiological coordina¬ 
tion, Inherited uevirotic dispositions, emotional instability, ab¬ 
normal fears, trauma, imitation, and many other things which 
have been present in various cases, are alleged to be causal, 
Indeed, stuttering has appeared in such an unusual variety 
of conditions and circunustances, and often with so many 
complications, that it is not at all surprising to find disagree¬ 
ment as to what the causal factors are. There is a host of 
scattered hypotheses. Usually several factors are considered 
operative at the same time. But which, and how ma^^y ? And 
which of these are dominant? Definite knowledge is lacking. 
There have been many scattered observations, but there seems 
to have been no systematic survey made on the basis of ex¬ 
periments set up to put hypotheses to a test and thus get 
evidence on a scientific basis. 

One important outcome of the numerous observations is 
a growth of the view that stuttering is not a disease in itself 

^This investigation has been in progress for two years, being under 
the authority of the Speech Clinic, University of Wisconsin, of 
which Doctor Smiley Blanton is the Director. The experiments (at 
tbe University of Wisconsin) were performed in a special research 
room in the psychology laboratory. Professor Joseph Jastrow and 
Professor Clarlc L, Hull are to be thanked for their great interest and 
valuable suggestions. The author is especially inclebled to Professor 
Hull for careful criticisms during the experimental work and in the 
preparation of the manuscript. The subjects, with .speech disorders, 
for these evperiments were obtained from the following sources; 
(1) cases at the Speech Clinic, University of Wi-sconsin, (2) cases 
at the Speech Clinic, United States Public Health Service Hospital, 
Walcesha, Wisconsin, and (3) cases at the Wisconsin Industrial Scliool 
for Boys, Wakesha, Wisconsin. 
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but only a symptom. II, then, it is not at its root essentially 
a speech defect, investigation of it must not be limited to 
vocal reactions. Mental conditions apart from speech must 
be studied, The purpose of this article is to present briefly 
some results of a number of special tests designed to detect 
and measure certain traits in reactions outside of the field 
of speech, and given in such a way as to show, if possible, 
whether these traits are definitely associated with stuttering, 
In view of the large number of alleged causes, this experi¬ 
mental work was planned so as to constitute a survey of sig¬ 
nificant types of mental and physiological processes which are 
common to vocal and non-vocal reactions. While there are, 
no doubt, both innate and external contributing factors, these 
tests were aimed principally at those which are innate, or at 
least internal. An essential part of the method consisted in 
a detailed comparison of groups of stutterers with groups of 
“normals.” Fortunately, it was also possible to include a 
group of ex-stutterers. At the University of Wisconsin, 
practically no treatment preceded the tests in these subjects. 

The tests whose results are reported, here are briefly de¬ 
scribed as follows: 

1— Foot tapping: 

If there is a general defect of physiological coordination, 
it could reasonably be expected to manifest itself in a tapping 
test, especially if the variability of tapping rate be measured, 
A foot tapping test was therefore set up in such a way as to 
get a graphic record of the sepai-ate taps. 

2— Hand coordination: 

It is well known that stutterers talk well under imposed 
rhythm. A test was then designed for coordination and 
rhythm in other than speech reactions. The subject went 
through certain complicated series of arm movements, in some 
trials following the beating of a metronome, and in other trials 
simply going as fast as he could. 

3— Block test; 

In view of alleged weak imagery, this and the two following 
tests were introduced. This one was devised as a test of 
memory span for movements. Four small wooden blocks 
were used, 

4 — Two-dot test: 

This test was aimed to detect weakness m the kinaesthetic 
field, With eyes closed, the subject made a certain arm move¬ 
ment (making a dot with a pencil on a piece of paper), and 
about one second later tried to reproduce the movement ex¬ 
actly. He was scored on.accuracy of reproduction, judgment 
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of his error, and on constant error (i. e. tendency to err with 
the second movement constantly in a given direction). 

5— Visual imagery; 

A few subjects were given visual imagery tests, some of 
which, e. g. the Binet Simon clock-test, are well known. 

6— Complex reaction-time; 

A familiar characteristic of the stutterer’s reactions, at least 
in speech and emotional situations, is instability. He is vari¬ 
able, He goes ahead by spurts. To possibly measure this 
instability, a typewriter with a device to expose the digits 1, 
2, 3, and 4, one at a time in irregular order, was set up in 
such a way as to get a graphic record of sixty reaction-times 
in uninterrupted succession. 

7— Inhibition.-. 

The characteristic spasms and blocking on words clearly 
suggest some defect of inhibition. A test was accordingly 
devised to measure inhibition outside of vocal reactions, A 
list of numbers in irregular order was read, and the subject 
was directed to respond by raising his arm slightly every time 
"3 ” was read immediately after an odd number but not after 
an even number. Forbidden responses, and also ])artially in¬ 
hibited forbidden responses, were recorded. 

Tables I and III summarize typical results of the subjects 
at the University of Wisconsin. Since certain changes were 
made in the tests before they were given to the second of 
these two groups of subjects, the results In the two cases are 
not always strictly comparable. Table II summarizes results 
from the boys at the Industrial School at Wakesha. It should 
be stated that the hand-coordination test and the inhibition 
test were slightly simplified for the subjects at the Industrial 
School and at the U, S. Public Health Service Hospital. These 
results will now be discussed in the order in which the tests 
appear in the Tables, 

An inspection of the i-esults of the first test in Tables I 
and III shows no consistent diflference between the stutterers 
and the normals in tapping rate. Ex-stutterers, however, die 
very rapid (Table III). A significant dilTerence'^ exists bc- 

2 Iti order for the difference between two averages to be significant, 
the difference should be at least 2.5 times its probable error. Thi.s 
probable error is obtained from the probable errors of the two 
average-s by the formula;— 

P. E.d=VP. E.^mi + P- E.=m2 

Throughout this article the term "significant difference'' thu.s means 
one which is at least 2.5 times Us P.E. In the above incntioiied case 
it is 3.2 limes its P.E. 




EXPERIMENTAL ANALYSIS OF CAUSES OF STUTTERING 343 


tween their average and that of the normals. This type of 
reaction, then, seems to be definitely associated with recovery 
from this speech defect. As to variability of. tappiiig rate, 
the improved stutterers have a much lower score than the 
normals. Obviously, there is no evidence here for any defect 
of coordination at this level, that is, of the rapid but coarse 
muscular movements of tapping. 

The next test, that of hand coordination, shows a char¬ 
acteristic difference between stutterers and nonnals, A care¬ 
ful comparison of Table II with Table III will make clear 
that the stutterers tend to do relatively better when following 
the beating of the metronome, while the normals tend to do 
relatively better without the metronome. "No. right” means 
number of trials passed without error. The results from ten 
stutterers at the hospital show the same tendency, but taken 
alone they are not sufficiently reliable for a conclusion. At 
any rate, it must be noted that the tendency, as far as it 
appears in these results, is in clear harmony with the well 
known effect of imposed rhythm on the stutterer's speech. The 
significance of this is that the trait appears to be general; 
here it seems to play an important role in reactions which 
have practically nothing to do with speech. If we compare 
the iinjjroved with the unimproved stutterers, another signifi¬ 
cant difference is found. It would appear from these sub¬ 
jects that the stage of improvement in speech essentially 
involves a marked disturbance in the types of coordination 
required in this test. This, however, needs further investi¬ 
gation, As to individuals, one patient who was troubled by 
being speechless from fear in militai-y situations, did very 
well in this test and remarked that he had very poor control 
in e. g. driving a car in tight places. He accounted for his 
doing well in this test by saying that there was no fear con¬ 
nected with it. 

The block test (Table III) shows the stutterers to be dis¬ 
tinctly inferior to the normals in memory span for move¬ 
ments, The scores in this test were also averaged separately 
for severe and mild cases; these averages were respectively 
24,1 and 30.4, with a significant difference. The question 
arises as to what bearing this has on theories of weak imagery, 
To consider this it is first necessary to ask if this is a test 
of mere imagery as such or whether it is a test of other func¬ 
tions along Avith imagery. Memory span tests have been used 
as tests of attention. What this test really tests is probably 
the ability to hold several things in mind at the same time. 
The stutteier liere appears to have difficulty in gi asping several 
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TABLE I 


Showing Results OP TiiEFmsTGROUPOf Subjects at the University or Wisconsin 
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TABLE II 

Showing Results op the Subjects at tub Wisconsin Industbiai. Sciitjoi. kou Dgys 
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TABLE III 

Showing Results of the Second Group of Subjects at the University or Wisconsin 
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movements simultaneously. The significance of the kinaes- 
thetic factor seems to be that in consciously directed speech 
movements a great many kinaesthetic elements must be held 
in mind simultaneously and thus coordinated. This the stut¬ 
terer is apparently unable to do. To the writer the most 
logical conclusion seems to be that the trouble lies in the 
coordination of imagery rather than in mere imagery as 
such i that the stutterer, especially in certain situations, lacks 
the ability to coordinate the kinaesthetic and other imaginal 
elements involved in speech movements when they appear in 
large numbers simultaneously. 

In the two-dot test the only significant difference found 
between the stutterers and the normals (Table II) was in “con¬ 
stant error,” the stutterers having the lowest score. Appar¬ 
ently, they have fully as good control as the normals of these 
movements made with the eyes closed. There does not, then, 
seem to be any weakness in the kinaesthetic field, that is, as 
far as arm movements are concerned. 

The results of the visual imagery tests given to twelve 
stutterers at the Hospital showed more correspondence with 
intelligence than with seventy of stuttering, Of the two 
men wlio did much better than the others in his test, one was 
a college graduate and the other had attended a university. 
They were both very bad stutterers. One p.ther stutterer had 
practically recovered; he succeeded in only.„one out of the 
seventeen points scored in this test. Those who appeared 
lowest in intelligence did poorly in this test. Now it can be 
said- of this test too that it tests “ attention ” along with 
imagery. But it differs radically from the above-mentioned 
" block testthe instructions were repeated, if necessary, so 
that it would not really be a test of “span,” that is, ability 
to hold a large number of things in the first grasp. 

In the complex reaction-time teat the stutterers do not 
seem to differ uniformly from the normals either in speed 
or in number of errors (false reactions). As to variability 
of reaction-time, the results do not show any strong indication 
that stutterers differ from normals. This test accordingly 
fails to give any evidence for greater instability or irregu¬ 
larity of reactions in stutterers than in normals. But there 
are, no doubt, characteristics of instability in other types of 
situations not reached by this test. Ex-stutterers, again, differ 
markedly from all the other subjects. They are unusually 
regular, as shown by their low score in variability of reaction- 
time, Here, then, is a trait which seems quite definitely asso¬ 
ciated with recovery from this speech defect. 
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The inhibition test shows no tendency in the stutterers to 
differ uniformly from the normals in mere amount of inhibi¬ 
tion, Among certain stutterers, however, there was observed 
to be some individual correspondence between. lack of inhibi¬ 
tion in this test and lack of inhibition in speech and other 
behavior. According to teachers at the Industrial School, 
some of the boys who showed much lack of inhibition in this 
test showed the same characteristic lack of inhibition in their 
behavior on the school grounds. One, e. g,, was quick to 
retaliate when out playing with tlie other boys, ITe had a 
"don't care" attitude, though he was much improved; he 
freely told, in a good natured way, how stubborn he had been 
when formerly brought into court. Another boy who showed 
much laclc of inhibition in this test was flighty and constantly 
getting into trouble; and stuttered only in rapid speech, not 
in reading. A boy who showed less lack of inhibition than 
the average in this test, dificreci also in the form of his 
stutter: he hesitated and showeef signs of hidden struggle 
in getting each word out. A stutterer, of another group, 
who showed much lack of inhibition in this test was troubled 
mainly by a strong tendency in all his behavior to react out 
of proportion to the intensity of the stimulus. Many of those 
who showed least lack of inhibition in this test (i. e. had fewest 
forbidden responses) showed great inhibition in their speech 
movements, 

Partially inhibited responses arc seen (Tables II and III) 
to be more numerous in the normals than in the stutterers. 
This relative scarcity of partial inhibitions in the latter shows 
itself clearly in both groups where recorded, while the number 
of completed forbidden resix)nses mentioned above varied in 
different groups of stutterers. This indicates that the stut¬ 
terers in these groups differ as to whether they will start 
or not start a wrong response, but they tend to agree in their 
inability to check or modify the response after it has started. 
It seems that the stutterer’s response tends to be of the all- 
or-none type; that the impulse does not get started at all as 
overt response or, if started, it cannot easily be stopped midway 
or modified. It must run its entire course. In this connection 
it must be remembered that in speech there is air immense 
number of impulses at play. If, then, there is decreased ability 
to check or modify impulses midway in their course of ex¬ 
pression, it is reasonable to expect greater disturbance from 
conflicting impulses and to eiq^cct blocking in speech move¬ 
ments to arise in this way. It is accordingly quite logical to 
assume that the trait which appears in this test, in a reaction 
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which is entirely outside of the field of speech, is an important 
part of the stutter mechanism. It is probably a general char¬ 
acteristic of the behavior of the individual, and common to 
many other than vocal reactions. This accords with the Unown 
fact that spasms and blockings analogous to stuttering occur 
in other than oral expressions, e. g., in writing mavements, 

The conclusions which at present seem most evident from 
these results may be formulated briefly as follows •. 

1 — No reliable evidence is found in the tapping test for any 
defect of coordination or motor control at the level of the 
rapid but coarse muscular movements of tapping. 

2— Rapidity in the type of reaction involved in tapping 
appears to be associated with recovery from stuttering. 

3— Regularity of tapping rate seems to be associated with 
improvement in stuttering. 

4— In the hand coordination test stutterers, in most groups, 
tend to do relatively better when following the beating of a 
metronome than when they simply go as fast as they can, 
while the opposite appears in normals. These findings are in 
harmony with the well loiown effect of imposed rhythm on the 
stutterer’s speech. Here it apparently plays an important 
role in reactions entirely outside of the vocal field, 

5— The stage of improvement in stuttering seems essen¬ 
tially to involve, a disturbance in the types of coordination 
required in the hand coordination test. 

6— The stutterers have in the block test a distinctly poorer 
memory span for movements than normals. It seems logical 
to consider the defect or difficulty to be one of coordination 
of the kinaesthetic and other imaginal elements when they 
appear in large numbers simultaneously, which happens, e. g,, 
in conscious speech movements. 

7— No evidence is found in the two-dot test for any weak¬ 
ness in the kinaesthetic field, that is, that part which is involved 
in arm movements. 

8— The results from the visual imagery tests (from 12 sub¬ 
jects) show more relation to intelligence than to severity of 
stuttering. 

9— No reliable difference is found between stutterers and 
normals as to speed or as to number of false reactions in the 
complex reaction-time test. 

10— Stutterers do not show any more instability or varia¬ 
bility of reactions in the complex reaction-time test than do 
normals. At least in this type of situation, stutterers appear 
to be fully as stable in their reactions as normals are, 

11— Ex-stutterers are unusually regular in speed in the com- 
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plex reaction-time test. This trait is evidently associated with 

'’? 2 -Stnt™r'erf d^fn^ in the inhibition test any ten¬ 
dency to differ uniformly from normals m mere amount of 

”n-Stutterers have in the inhibition test fewer pardally 
in ibhed responses than normals.. It seems very pro abe 
u tTpneral lack oE ability to inhibit an impulse after it has 
found pS expression is an essential factor in stuttering. 



AN EXPERIMENT IN THE USE OF MUSIC IN AN 
ARCI-IITECTURAL DRAFTING ROOM 


By Esther L. GATfiwooD 


This study undertakes to investigate the use of music in 
a specific situation, namely in an architectural drafting room, 
when the men are at work. Is the use of music of any value 
or significance in such a situation? 

Many old legends relate stories of the effects of music 
upon the feelings and actions of the listener. More recent 
literature, with some historical authority, reports similar in¬ 
stances, Recently, experimental studies have been undertaken 
to scientifically prove or disprove these beliefs. Practically 
all of the reports and most of the experimental work liave dealt 
with the passive listener, from the standpoint of enjoyment, 
of musical pleasure.* The effect of music upon work pro¬ 
duced or upon people at work has not been systematically 
studied, although occasional references to its possible effect 
have been made. 

A few scattered unregulated observations have been made 
on the use of music in learning typewriting, and certain other 
mechanical processes. These have, however, never been done 
under laboratory conditions, where the situation is controlled. 
No objective measurements have been made, nor have there 
been organized introspective reports. The lechiiiciuc and the 
reliability of the results are open to question. Attempts to 
obtain definite details from those who are reported to have 
made such experiments have resulted in the receipt of letters 
proclaiming the “wonderful effects,” “greatly stimulating 
effect,” “ the imhclievable aid,” etc., but giving no quavAtita- 
tive data. 

For several months, niy office was located, by chance, near 
the large drafting room of the department of Architecture 
of the Carnegie Institute of Technology. The work of the 


* Gehring, Albert. The Basis of Musical Pleasure. 1910, New York. 
Gilman, B. J, Report of Experimental Test of Musical Exprc.ssive- 
ness. Am. Jour, Psyeh., 1&91, 1892, vols. 4, 5. 

Downey, June. A Musical Experiment. Am.Jcnr. Psych., 1899, v. 9. 
Weld, H, P. An Experimental Study of Musical Enjoyment. Am. 
Jour. Psych., 1912, vol. 23. 

Mobicr, Louis, Music Moods, 1916. Columbia Grapliophonc Co„ 
N. Y, 
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students in this department is so arranged that each is given 
a big problem every six weeks. Most of this time they spend 
studying out the various parts of their respective problems. 
Ail the details are carefully planned and tried out before 
actual work on .the drawing is begun. About a week before 
the finished sheet is due, they start to work. 

Toward tlie end of the period, the men work early and 
late. The last four or five days, the students are " oii char- 
ettc.*’- Tlie last few nights of the diarette period, they work 
until very late, two a. m. being the closing time of the longest 
evening allowed. 

Several times, when students were “ on charette " some of 
the men had asked me for the use of the phonograph and a 
few records. Two of the men usually picked out a group of 
selections, which they used. The exact content of these groups, 
I do not know, except that a large proportion of it was late 
popular music, much of it y.izz. 

There was no question as to the enthusiasm of the men 
over having music occasionally. I was told frequently by 
various ones how much they had enjoyed it and how much 
it had helped them. However, from such remarks and testi¬ 
monials, it is both unwise and unsafe to draw conclusions. 
That is exactly the unreliable basis for much of the popular 
literature on the influence of music. The fact that a few 
liked it was no evidence that others did, nor was there any 
certainty that the selections which these men chose represented 
the type of music others would like. Nor could one conclude 
that the selections which were chosen were the best for this 
particular purpose. Their reports were suggestive, but not 
conclusive, and I iindcrloolc to study these questions; 

(1) Is music of any help in this particular situation, namely, 
the actual work of completing plans and drawings in an archi¬ 
tectural drafting room? 

(2) Is music, on the contrary, an unfavorable distraction 
to the worlcer? 

(3) What type of music is most preferred under such cir¬ 
cumstances? 

(4) If music is desirable, in what way does the worker 
feel that the music helps? 

2 The term, "on charette ” is brought over from the French. When 
plans and charts were due, a little cart used to go about through the 
streets to gather them in. Draftsmen were often seen running along 
behind the carl putting on the finishing touches. The term is now 
used to indicate the period of Intense work, when finishing ardii- 
tectural plan.? or drawings. 



352 


GATEWCXJD 


(5) If music were coastaiitly available, in wliat time units 
would- it be used to the best advantage? 

The situation in the drafting room made an ideal one for 
experimentation. Arrangements were made for one of the 
assistants to have the instrument brought ijito the drafting 
room just as on the previous occasions when they had bor¬ 
rowed it. They kept the iiistniinciit going in the iisuaJ nuin- 
ner, except that the re-creations used were those which I had 
selected for the occasion. The experimenter was merely a 
visitor with some of the students and none of them knew 
until afterwards (liat the music was being played with a pur¬ 
pose on this occasion, Many of the men cx[5rc.ssed surprise 
when they realized why the writer had been llicve. The music 
was therefore introduced in a manner wiiich caused no dis¬ 
ruption to the worlc, and none of the antagonism to experi¬ 
mentation, which is so often felt, was aroused, The condi¬ 
tions were carefully controlled and at the same time, were 
perfectly normal so far as the students were concerned, 

The data sheet, like the accompanying form, was prepared. 
This was so planned that it was unnecessary for one to write 
lengthy answers to any of the questions; a check mark or 
figure sufficed, This was done for two rca.sons. First, it 
made the answers comparable. Too often results of such 
experiments are given ip terms of the remarks of the observers, 
and there is no satisfactory means of converting the opinion 
of one into the same terms a.s the opinion of another. Sec¬ 
ond, it required as little time as possible from the men at 
work, and their serious cooperation was thus obtained, whereas, 
with a lengthy questionnaire which required much of their 
time, they would have been unwilling observers. These report 
sheets were passed out at the end of two hours, Only then 
did the men suspect that the music had been given to them 
for a purpose. They were much interested and serious in 
their reports. 

An Edison “ laboratory model” phonograph, the same which 
had been loaned to them on previous occasions was used. A 
set of re-creations (the Edison trade name for their phono¬ 
graphic records) was purposefully selected so that it included 
various types of music, of instrument and rendition. The 
entire group contained forty-five selections, several each of 
band, orchestra, chorus, instrumental solos and vocal solos, 
rhythmic waltzes, one vocal quartet and many jazz or popular 
dance numbers. Some of the jazz selections were not used, 
so that the number was somewhat reduced. The instrumental 
solos included violin, piano, flute and cello; the vocal solos, 
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each kind of voice, soprano, contralto, tenor and baritone. I 
had previously arranged the re-creations in such a way that 
there was a fairly even distribution of each type, 


Name.Date. 

Check the appropriate answers in the blank spaces indicated, 

Does the presence of music make your work any easier? 

Yes.No. 

Docs the music distract you from your work? 

Yes.No. 

Check the types of music which you liked best (not in general, but with 
your work tonight). Check one of each pair. 

Instrumental.Vocal. 

L/)ud.Soft. 

Slow.Fast. 

Non-jazz.Jazz. 

Familiar.. .Unfamiliar. 

Number in order the types you preferred most with your work. 

Standard orchestral selections. 

Instrumental (violin, piano, etc.) solos. 

Vocal solos. 

Jazzy dance numbers. 

Rhythmic waltzes. 

Lively chorus numbers. 

How do you think music helps? Check. 

Rhythm speeds actual work. 

Keeps you happy. 

As rest between work. 

Give any other reason.'. 

Assuming you could have music whenever you wanted it, how often 
would you have it? CJieck. 

Rarely and for a short period. 

" “ “ " long " . 

Often and for a short period. 

.long " . 

Most of the time.. 

Not at all. 


Remarks 


Results .—Replies were received from fifty-six men, although 
not all answered every question. To the first question, "does 
music make work easier?" forty-nine (49) answered 'yes' 
and only five (5) ‘no,’ Six (6) men declared that music 
distracted them from their work, while forty-seven (47) an¬ 
swered that it did not. The seeming inconsistency of the 
one person who claimed that music distracted him and yet 
that it made work easier is not impossible. He was one of 
those who felt that music was a help if used as a rest at 
intervals between work periods. 
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In answer to the third f|ueslion, on the various types of 
music most suitable, the preferences are exj)resse(l in the fol¬ 
lowing table, which is arranged to show the contrasting types; 


instrumental. 

... 37 

vocal. 

... 3 

loud. 

... 19 

soft. 

... 19 

slow. 

. ,. 15 

fast. 

... 12 


15 


... 22 

familiar. 

... 30 

unfamiliar. 

... 2 


Not only do the figures show that instrumental selections are 
very much preferred to vocal numbers, hut also the comments 
made whenever vocal selections were played, showed that they 
were irritating. According to a questionnaire sent out to 
a large number of phonograph owners, many more people 
express a liking for vocal music in general than for instru¬ 
mental. In this sort of a circumstance, liowever, wlien the 
individuals are working, and the music is merely an incidental 
feature, instrumental music is greatly preferred. Either voice 
quality, ot what is more likely, the presence of words, proved 
to be an irritation as well as a distraction. The effect i.s very 
like that which one experiences when he is trying to prepare a 
lesson or write a theme, and some one in llic room talks to 
himself or to some one else. There is usually an effort to 
listen to at least a part of the words, and the attention of the 
worker shifts back and forth from the song to his work. This 
interruption is not evident with instrumental music. 

Vocal music compels the attention, whether willing or un¬ 
willing, of the audience. It forces itself upon its hearer.s. 
This fact is evident in a drawing-room parly. If some one 
renders a vocal solo, the audience usually gives attention 
whether the performance be good or bad. On the other hand, 
if some one gives a piano solo, oft-times in spite of the fact 
that it is unusually well done, the music is iiileiprctcd as a 
signal for conversation. Certainly, if the audience i.s given 
to conversation, the presence of instrumental music is not 
the distraction that vocal music is. 

There was an almost equal division of opinion on the ques¬ 
tion of tempo and volume. Usually slow tempo and soft were 
preferred by the same individual and fast tempo and loud by 
the same individual. It is difficult to determine just how much 
of this is indicative of the individual’.s own [)cisonal prefer¬ 
ences, and his preference for this particular kind of mnsic. 
when working. Special pains were taken however to have 
the comparison on the basis of the selections just heard, and 
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I do feel that the judgments rendered are reliable. One can 
readily understand why loud and fast, and soft and slow are 
linked up together. Loud slow music forces itself upon the 
listener, in accented puctuated measure th^t distracts, and also 
causes the movement to lag. Slow soft music, on the other 
hand, is very soothing and rarely annoys or even distracts the 
hearer. 

More scored jazx than scored non-jazz, and several did not 
score cither. Tho.se who did not score either gave answers to 
some of Che other questions which would make a scoring on 
jazz very unlilcely, so that the division between the two is 
approximately equal. 

Familiar music is greatly preferred to unfamiliar music, 
Several men explained that if the selection were a new one, 
they wanted to listen to the melody, and if it were a song, 
they listened to the words. In a selection that is already 
familiar, little or no attention is consciously given to the words, 
and the music is merely a pleasant accompaniment to the 
work, and in no way a distraction. 

The selections used for the experiment included several of 
each of the following types: standard orchestral, instrumental 
solos, vocal .solos, jazzy dance nuinhers, rhythmic waltzes, and 
some lively chorus numbers. In question four, the men were 
asked to indicate the oitler in which they preferred the several 
types. The relative order of the various types proved to be 
the following: 

1. Jazzy dance 

2. Standard orchestral 

3. Rhythmic waltz 

4. Instrumental solo 

5. Lively chorus 

6. Vocal solo 

This rank order is based on the number of fii'st, second and 
third rank votes given each type by the entire group of men, 
From whatever angle the data are studied, solo numbers are 
less desirable than ensemble, and vocal music less desirable 
than instrumental. It is evident that vocal music is not suit¬ 
able for such a purpose as we are investigating. Those who 
gave the most careful consideration to the whole questionnaire, 
ranked instrumental solos and orchestral numbers higher than 
they did tlic two dance types. This however may be an indi¬ 
cation of the more serious tyrpe of individual and his prefer¬ 
ence for music other than the dance. 

One other argument, from an objective viewpoint, lends 
favor to the use of .standard orchestral selections in preference 
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to the jazz type. The room is noticeably noisier when loud 
jazzy numbers are played and more talking goes on. Some 
of the energy of the worker goes out in a form that does 
not show in his drawing.s. When quieter, more standard selec¬ 
tions are played, there is less confusion in the room and one 
worker does not disturb another. It is possible that some 
individuals may work better in short periods between jazz 
numbers, and so in the end accomplish as much as those who 
work continuously using a difFerent type of music. This is 
not likely oE the group as a whole, although a certain amount 
of the livelier sort of music is doubtless useful. 

Determination of the causes of the beneficial results from 
using music during the charetting period is more difficult. A 
comparison of the introspective judgments of the entire group 
brought out some interesting facts. Only three explanations 
were suggested oil the data sheet, no others having at any 
time been offered. Asking on the data sheet for other reasons, 
and questioning some of the men informally afterwards 
brought out no further explanations. 

Twenty-two (22) of the men felt that the iniusic actually 
speeded their work, that fast rhythmic selections quickened 
their movements. Some explained that they felt a tendency 
to keep the rhythm of the music as they drew, as for example, 
in shading, However, with most of them, the music seemed 
to be rather a nervous stimulation, which brought out in¬ 
creased activity in the work. This speeding the movements is 
in keeping with the preference on the part of many for the 
quick jazz music, and the livelier orchestral selections, 

Forty-one (41) of the draftsmen asserted that music keeps 
them happier, and that they can do more work and better 
work when they are in good spirits. Twenty (20) of them 
explained that the music furnished a rest period between 
working periods. This function may not be unlike that of 
keeping the men happy, although the temporal use is different. 
To those who prefer it as rest, at intervals, there arises the 
difficulty of determining the proper intervals, and ihdeed this 
element is apt to vary with individuals to such an extent that 
with a large group it would be extremely difficult. How¬ 
ever, what seems to be the explanation, is that the listener is 
able to ignore the music and consider only his problem 
when he is working and really notice the music only when 
he pauses to re.st or to think over the next step in liis work. 

Not a few of the men indicated more than one of the above 
replies. Many of them suggested that the mu,sic helped keep 
them in good spirits, and also that it served cither as an actual 
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accelerator to their work, or as a rest. There is certainly no 
doubt in the minds of the men who have tried it that either 
by actually speeding' the movements of the worker or by men¬ 
tally stimulating him, music does increase the ease with which 
this work is done. 

As a result of the last question, concerning the most satis¬ 
factory time distribution, the desirability of the music was 
further suljstaritiated. Twenty-one (21) replied that if they 
could choose the time, they would have the music often arid 
for short periods, nine (9) often and for long periods. Twen¬ 
ty-eight (28) answered that (hey would like it most of the 
time. Some few stated explicitly that they would like it most 
of the time, but in short periods, some others that their prefer¬ 
ence would vary with the circumstances. Only one (1) as¬ 
serted that he would want it “ not at all,” none “ rarely and 
for sliort periods.” No exact definition was given of the 
length of a long period or a short period. A long period was 
taken to mean continuous playing for approximately half an 
hour, while a short period was taken to mean the playing 
of three or four records, followed by a period without music. 
Many of the men expressed the opinion that they would pre¬ 
fer it frequently and for short periods, while an equal number 
prefer it nio.st of the time. There seems to be no doubt' in 
the minds of these men at least that music is a highly desirable 
nccompanimcnt to tlicir work. 

Conclusions 

(1) The U.SC of music, rendered by means of the phono¬ 
graph, was felt by the workers in an architectural drafting 
room to be of decided advantage. 

(2) Only a small percentage of the workers reported that 
they found the music a distraction or a hindrance to their 
work. 

(.3) Instiiimeiital i77u.?ic is imirh preferred to vocal music 
for this purpose. 

(4) Music unfamiliar to the listener is not as desirable as 
familiar music. It becomes more or less of a distraction. 

(5) According to the reports of the workers, the aid of 
music is of two sorts. Many feel that it actually speeds 
movement, and practically all the workers find that it has a 
beneficial effect on the mood or spirits, which in turn is re¬ 
flected in the work. It is not unlikely that it performs both 
of these functions. 

(6) Music is not a feature to be used rarely as a sort of 
diversioji or intermission, but instead may be used to advan- 
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tage along with the work, a large part of the lime. To have 
music frequently and for short periods iqjpears to be most 
desirable and beneficial. 

So many unfounded stalcmciit.s liavc been made on the 
advantages or values of music in industrial situaiions, that 
tlie natural result lias been a tendency to ci)n.sid(M' all such 
reports the mere opinion of some sentinienlal c‘iilhusia.st. It 
is, therefore, of peculiar significance that llu: lesulLs of such 
an experiment, unbiased by any popular enthiisia.sni, should 
be positive, and tliat the workers themselves should he so 
definitely convinced of the desirability of the use of [luisic. 
It is not safe to generalise from this particular i^erforinance 
to other industrial situations, but it is not unlikely that experi¬ 
ments in many other fields may show similar results. How¬ 
ever, wc can safely say that the introduction of certain kinds 
of music proves to be both desirable and beneficial in the 
drafting room. 



THE RESULTS OF SOME TESTS ON FULL AND 
MIXED BLOOD INDIANS^ 

Hy Thomas 1L Gahtii, University of Texas 

The olijective of Racial Psychology of an experimental 
character should l)e first to find norms and the measures of 
variabilities aiotmd these norms. ITiesc should stand as in¬ 
ventories *of the races ineasured. But if we follow out the 
latter concej)tion the complete distributions of the measures 
would be a truer representation of the facts, And having 
obtained tlicsc, our next intention would be to make com¬ 
parisons between the races. Even though our method may be 
avowedly scientific, we may well take caution in the making 
of those comparisons because of the ever present bias due to 
race prejudice which may cause us to hasten to conclusions 
and thus endanger the socallcd inferior races with the 
stigma of being rated low. For this reason there ought 
to be a carioti in the study of race psychology similar to the 
fainoii.s Canon of Lloyd Morgan in his studies of animal 
beliavior. While Morgan’s basal principle reads: “In no case 
may we hUer[)rct an action as tlic outcome of the exercise of 
a higher psychical faculty" (of lower animals), “if it can 
be inlecprctcd as the outcome of the exercise of one which 
stands lower in the p.sychological scale;” liie canon for race 
psychology might read after this fashion (with due apologies 
to the British scientist): In no case may we interpret an 
action as the outcome of tlie exercise of an inferior psychical 
faculty, if it can he interpreted as the outcome of the exercise 
of one wiilcli stands luglier in the psychological scale, but is 
hindered by lack of training. 

There is still a third objective in the study of racial psy¬ 
chology of which little has been said and of which insufficient 
use lias been consciously made. Mental mensuvement has 
taught us to seek out the subnormal child so that we 
may give him .such opportunity a.s be may need to bring 
him to his full development. Measures of the inferior races 
have indicated some superior individuals in the racial group 
who even take a position beside those above the median of 
the superior race with which we are comparing them. The 
third objective then of racial (wychology .should be to discover 
the.se .superior inrlivitlual.s who find themselves contending 
with unfavoial)lc environmental and traditional co nditions, It 

' Pajier rend before Amcriciin Psychological A-ssociation, Chicago, 
Dcccmlier .10, 1920. 
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is not in the province of racinl psychology to imlicaie ^\hat 
sliould be done for these " suijeriors,'' 1)1 il only to liiid tbest 
individuals. 

While the problem involved in the exjvevinient which is lo 
be de.scribcd and iiilcrprcted is to iind oiii bow Mixed and 
Full Blood Indians differ in ihc resuUs of ilieii iieidoi iufmccs 
of nine psychological tests, it has all the objectives iiunuioiicd 
above eiiiborliKcl in it, llioiij;li it arrives at tliem in a [irelim- 
inary fashion. 

The subjects included three Imndrid and eighty-four 
Indians of the United Stales Indian School at Chilocco, 
Oklahoma, of whom I'JS were males, 77 being mixed blood 
and 121 full blnod Indiaii.s, iind 185 fciiiiiles, 78 being mixed 
and 108 full blood.s. Nearly all of them were J'laiiis and 
Forest Indians. Their ages ranged from 9 to 25 years 
and their educational uttaininent ranged from the fourth tc 
the tenth grade, To these Indian students were given four 
association tests; Opposites, gcuns-species, iiart-whole, am! 
free (continuous) association; three niemoiy le.sis; concrete 
and abstract rote memory anti logical inciuory ; aixl two word’ 
building tests: iipiric and acnbiiil. 

These tests were given in the sjrring of 1920, Tlie tech 
nique was the same as that used by I’ylc and liis a.ssociatcs ii 
giving all of these tests to Whiles and Negroes, and some o 
thein to Chbcsc. (Sdiool and Society, Vol. I, j), 357 aiu 
Vol, II. p, 264.) Ollier tests were given bill lire ic.snlts nr 
not presented in this paper, 

While it will be observed from the above dc.sci'i[)tion tlia 
we have here groups of different age*;, education, ruul se> 
as well as different blood, the subjects wove classihod wit 
reference only to sex, raciad blood, and age. A further breal^ 
ing up of the original group of subjects into educatianal grad 
groups would malrc the 3ub-grou)>s too siunll. so that tin 
clas.dficatiou has been deferred until larger luiinbcrs of India 
children can be -secured for testing with the same materia 
The first draft of the data is presented in ihe accnmpaiiyiii 
tables, the data for the males being given in Table I an 
that for the females in Table II. In both tables, as wc ha^ 
said, the data for Mixed Bloods and Full Bloods are Ice] 
separate and these large groups are again subdivided into aj 
groups running from 9 years to adult age, which means he 
from 19 to 26 years. Tlie number of cases for each a} 
group is designated also. In the Mixed Blood groups {' 
both sexes the average degree of Indian Blood for an a| 
group is indicated, and for all age groups wc liavc tl 
average school grade attainment. The subjects were jii 
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finishing the designated school grades, for the tests were 
given in March or toward the close of the school year, The 
tables give the averages, the A. D., P. E„ and range for all 
age group divisions for every mcasiirejncnt ujidertaken. In 
addition is shown the overlapping in each age group from 
the 14th year up, which indicates the per cent of Mixed 
Bloods attaining and exceeding the median score of the Full 
Bloods, 

Tlie norms for Mixed and Full Blood Indians shown here 
are of necessity only ttmlative because of the si 2 e of the groups. 
It is likely that radical changes will occur in them when more 
racial material of a similar kind can be obtained. However, 
within Lite limits of the data at hand, wc may say what follows. 
In our searcli for differences which these data show between 
Mixed and Full Bloods of the Indian race, we shall consider 
these facts: 

I. Tlie average of eacli age group for Mixed Bloods and 
Full Bloods; 

II. The instances where 60% or more of the Mixed Bloods 
attained tlie median of tlie Full Blood scores in each age 
group; and 

III. A comparison of range of the Mixed Bloods and of 
the Full Bloods. 

IV. However, inferences drawn from these findings must 
be modified l)y the dilTcrences in educational atiainment and 
social status between the Mixed and Full Bloods, 

If wc take for iniriwscs of comparison the average per¬ 
formance of cacli group of mixed and full blood individuals 
for each Lest wc find that the Mixed Bloods excel the Full 
Bloods in most of the cases. In the case of the comparison 
of the rcsult.s for the males, the Full Blood fifteen year and 
adult group.s excel in free association; their fourteen and 
eighteen year groups excel in concrete memory; their seven¬ 
teen year group in abstract memory; their fifteen, eighteen 
year and adult groups in both word-building tests; and their 
seventeen year group in the second word-building test. That 
is, there arc twelve instances in which the average of these 
full blood Indians excel out of fifty-four possible instances, 
or 22^0 of the time. The case of the females is not even so 
good as this, for there are only four instances in which the 
Full Bloods excel the Mixed Bloods, i. e., the adult group 
in genus-species, (he fourteen year and adult group in con¬ 
crete memory, and the adult group in abstract memory. This 
makes four out of a possible fifty-four, or 7% of the in¬ 
stances. Then the evidence from comparison of the averages 
favor.s the Mixed Blood.s. 
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A fairer test would be to find the overlapping, as for in¬ 
stance, to what extent the Mixed Bloods excel or attain the 
median of the Full Bloods. We find that for each test 60% 
and better of the Mixed Bloods attain and exceed the median 
of the Full Bloods for each age group in all testa except 
in the following instances: males, fifteen year olds in oppo¬ 
sites, eighteen year olds and adults in genus-species, eighteen 
year olds in concrete memory, scvejiteeii year olds in ahstract 
memory, fifteen year olds and adults in logical nieinory, fifteen 
year olds and adults in part-whole, likewise, and fifteen, eigh¬ 
teen year olds and adults in both word-huilding tcsl.s; females, 
adult group in genus-species, fotirtecn year olds in free asso¬ 
ciation, and adults vn abstract memory, seventeen year olds 
and adults in part-whole association and also in tlie first word¬ 
building test, and sixteen year olds in the second word-build¬ 
ing test. To sum this up the Mixed Bloods have this 60% 
and better of their respective groups attaiiiingr and exceeding 
the median of the Full Blood in 39 out of a possible 54, or 
72% of the time for the males, and 46 owl of 54 times, or 
84.4% of the time for the females. This likewise favors the 
Mixed Bloods, 

Attention should be called to the ftu:t tliat in making the 
above comparisons certain age groups of the Full Bloods 
stand out prominently in several of the tests, particularly 
the fifteen year, eighteen year, and adult gi'on()s of males, 
and the adult females. There are evidently more su¬ 
perior individuals in these age groups than in the other 
age groups of the FuU Bloods. This naturally bviugs 
us to a consideratian of the range in the various age groups 
for purposes of comparison. Upon making such an inves¬ 
tigation we find for the males that the upper range of the 
Mixed Bloods is greater than that of the Full Bloods 51.8% 
of the time, using the age groups here as bases for comparison 
as before, or 28 out of 54 times. For the rest of the time 
the latter excelled the former in going .beyond their upper 
range, except twice, when their upper ranges were equal. In 
Other words, for every excellent performance of any Mixed 
Blood individual, nearly half the time there was a full- 
blood Indian to matdi his performance or to excel it. It is 
not so for the females of this blood group, for when 
their upper range is compared with that of tlic otlicr blood 
group of their sex it is seen that 40 times out of 54 the 
Mixed Blood upper range is greater than that of the Full 
Bloods i, e., 74% of the time. In only nine instances was the 
upper range of the latter female group greater than that of 
the former and in five instances it was equal to it, 
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As to the Full Blood lower range, it was below that of 
the Mixed Bloods 34 out of 54 times —62.9% of the time 

tlie iiialci;, and it was about the same, 35 times out of 54 
—64.8% for the females, and as good or better for both 
sexes during the rest of tlie time. The presence of the 
superior performers among Full Bloods in the 14, 18 year, 
and adult groups for the males is again made evident by 
this examination of the range, and it is somewhat so for the 
female adults. 

Before undertaking to draw conclusions from the above 
coinparl.sons, two additional factors should be considered, i. e., 
social status and education. The data at hand offer little infor¬ 
mation with reference to social status. Weeansaythat thcmales, 
from the fourteenth year up, were on the average 54% Indian 
blood, and the females slightly more, but both are practically 
the same, and while we know little of the social status it is 
safe to draw the inference that since they were nearly half 
white, all of them being mixtures of whites and Indians, the 
influence of the \vl>ite parent would necessarily improve the 
social status from the white standpoint and this would be 
above that of the individual of full blood parentage more or 
less biased by primitive traditions. And as to education, the 
average attaimiicut for the Mixed Blood males is 7,4 grades, 
ranging from 5th to 10th grade and for the females was 7,3 
grades, ranging from 4th to 10th; whereas for the Full Blood 
males the average school attainment is 6,2 grades ranging 
from 4th to 10th grades, and for the females 5.8 grades, rang¬ 
ing from 4th to 9th. 

The relative lack of social pressure to go to school is 
evident in the Full Blood group which, to be sure, is the 
result of primitive apathy or lack of enthusiasm for the 
white man's education. Nevertheless, this should not be re¬ 
garded as peculiarly an Indian trait, though it assuredly mili¬ 
tates here against better performance in the psychological tests 
for the Full Blood Indian. 

From the above experiment then we conclude that in a 
comparison of Mixed and Full Blood Indians as to their 
ability in the performance of certain tests, the Mixed Bloods 
tend to excel the Full Blood.s on a score of averages, measure 
of per cent of the former to attain the median of the latter 
and as to upper range of .scores, but many Full Blood indi¬ 
viduals attain and excel the performance of Mixed Blood 
individuals. Furthermore the scores of the Mixed Bloods is 
favored hy their .superior social status and educational oppor¬ 
tunity. However, the writer doubts if an ec|uality of school 
attainment would remove the indicated differences, not as 
measured, but in their trend. 
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A TEST FOR USE IN THE SELECTION OF 
STENOGRAPHERS 


My M. A. Carnegie Instilulc of Tccliiiology 


I l)ii results oi using a battery of tests for the selection of 
slGiiOKrai)liers were described in the Sejitcinber issue of the 
JouHNAL 01 ' Ai>i'ijk}> Psvciiolo«v. Further data regarding 
these tests liave recently been collccted> particularly with re¬ 
spect to the eliinin.'ttion from training courises, of those persons 
who arc certain to fail. 

In the previous investigation, the criterion of success con¬ 
sisted of the recoinniciidations of the teachers in English, Type¬ 
writing and Stenography, made in January after five months' 
observation of girls bciJig trained as stenographers, The tests 
which were found useful in eliminating failures were Bureau 
Test Vr (an ‘intelligence' test) and Bureau Test IX (a test 
of will traits), On the basis of the January ratings as a 
criterion, a score of 50 in Test VI and a score of 60 in Test 
IX, Part 10, were assumed as "critical" scores for success in 
the course. This .standard in Test VI would have eliminated 
eleven failures and one success. 

Tlje p.^ssing of five more months led to some revision of 
rccomineiKlations by the instructors, and the test scores are, in 
the pre.seiil study, regarded in the liglit of the changes in the 
criterion. The accompanying figure (Chart I) shows the re¬ 
lation of test scores to the January and the June ratings, Along 
liic ordinate are represented scores in Test VI, and along the 
abscissa arc shown the judgments of success or failure. As 
the previous article stated, a person who was recommended for 
continued work in typewriting or stenography, or for advanced 
courses, was considered a ‘ success/ Those who were recom¬ 
mended for service in manufacturing or clerical work were 
considered ‘ failures/ Each circle on the chart represents a 
person. 

It is apparent that the later and more reliable criterion has 
justified a readjustment of the critical sojrc for Test VI. The 
individual scoring 40, who was considered a success in January, 
has failed to "make good." Of the eight persons scoring 
between 50 and 60, two were regarded as failures in January 
and also in June, four were shifted from success in January 
to failure in June, one considered successful in January had 



374 


BILLS 


left before the end of the training course, and only one re¬ 
garded as successful at the earlier time was still classiRed as 
successful. 

These data justify the raising of the critical score in Test 
VI, for success in stenography, ten points—^that is, from 50 
to 60. In this way, eighteen failures and only one success are 
eliminated by Test VI alone.^ In tabular form, omitting the 
cases of individuals leaving the course before completion, these 


results are as follows: 

Failed in test and failed in course,... 18 

Succeeded in test and failed in course. 9 

Failed in test and succeeded in course. 1 

Succeeded in test and succeeded in course. 39 


Total 67 

Per cent correcc .... 85 


In order to test these results further, three different groups 
of professional stenographers have recently been given Test 
VI. The first group consisted of twenty stenographers em¬ 
ployed by a single firm. Before the test was given to this 
group, the stenographers were rated on their value to the firm, 
by an executive who was in close contact with all of them. 
Of these twenty stenographers, only one made a score below 
the critical score set for the students of stenography, i. e., 60, 
and she was rated lowest by the firm. Table I shows the test 
scores of the group and their ratings by the executive. The 
rank correlation is -}-.75. When it is considered that length 
of setvitt must have played son’kc jjarl in the tating, this cor¬ 
relation must be regarded as remarkably high. 

A second group, consisting of seventeen stenographers and 
eight secretaries employed by a different firm (in an entirely 
different line of business) were given the same test. They 
were rated by an executive who knew them all, but did not 
wish, to rank them. He divided them into three groups: those 
who were “ failing,” those who were “ getting by ” and those 
who were “ good." Three of the seventeen were classed as 
"failures," 4 as "getting by” and 8 as "good.” Two had 
been with the company too short a time to be rated. All of 
the secretaries were classed as "good." Table 2 gives the 
ratings, scores and positions of these stenographers- 

The mean score for secretaries is 144, for stenographers 
rated "good,” llO; for stenographers rated as "getting by,” 
65; and for those “ failing,” 63. Only two made a .score less 
^ Tlic .standard of fiO in Test IX, Part 10, would have eliminated 
three who_ failed in January and none who succeeded. These tlirec 
persons (indicated on the chart by the circles with dots) left the 
training course before the June rating. 
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than the critical score determined by the training school experi¬ 
ment, and neither of these was rated “ good.” 

The third group examined consisted of fourteen high grade 
stenographers from five different companies. Each company 
was asked to have the test given to their three best stenogra¬ 
phers, The lowest score made was 109 and the mean score 
was 153. 

The data for the original training school group, and for 
each of the three supplementary groups tested, are given in 
Chart II. Scores in Test VI are represented by the abscissa, 
and the number of cases Is shown by the ordinate, 

From the investigation as a whole, evidence is found that 
there is a positive relation between mental alertness as indi¬ 
cated by Test VI, and ability in stenographic work. The 
designation of a score of 60 in this test as a " critical score ” 
for selecting stenographers is justified by the data secured 
from these various groups. 

CHART I. 

RitLATiON OF Score tH Test VI to Success and Faillbb jn Stbnocraphi 
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TABLE I 

Relation of Score in Test VI to Vai.oe to Firm of Twenty 
Stenograph isRS 


Scare in 

Test VI Ranking 

Rating on Value 
to Firm by 0 fTice 
Manager 

A. 
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20 

20 

B. 

163 

19 

19 

C. 

152 

18 

16 

D. 

139 

17 

17 

E. 

134 

16 

15 

F... 

130 

15 

12 

G.- 

125 

14 

14 

H. 

118 

13 

9 

I. 

114 

12 

4 

J. 

113 

10.5 

6 

K. 

113 

10.5 

13 

L,.. 

no 

9 

18 

M. 

105 

8 

8 

N. 

86 

7 

2 

0. 

82 

6 

7 

P. 

n 

5 

U 


76 

4 

10 

t5 

72 

3 

3 

S. 

61 

2 

5 

T. 

52 

1 

1 


TABLE II 

RELATION OF SCORE IN TEST VI TO ABILITY IN STENOCRAPIIY 

Rating Score In position 

Bureau Test VI 


Good ... 

a 

41 

4i 

<* 

U . 

It 

4i 


. 179 . 
. 155 . 
. 152 . 
. 150 
. 150 
. 139 
. 137 . 
. 93 

. Secrctaiy 

«l 

11 

M 

n 


. 155 
. 129 . 
125 

,. . Stenographer 

11 

l< 


. 117 
. 94 

91 

1 a 

la 
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l« 

<* 


7R 

11 

" Getting By . 


. 80 
72 

11 

11 

it 


62 

11 

M 


An 

11 

Failing . 


. 74 

7.3 

11 

11 
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. 42 
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PAPER AND PENCIL RESEARCH IN THE COLLEGE 
CLASSROOM 


By Donaui a. Laird, Univcrsily of Iowa 


It was about two decades ago that psychology extended Its 
methods to include more than the prosaic brass instrument 
laboratory and philosophic convictions. It was about this long 
ago that the paper and pencil psychologist ushered in the era 
of tests, Paper and pencil methods were employed in psycho¬ 
logical work early in its development, Questionnaires were 
used to a large extent by the early .student of the psychology 
of religion and during the epoch of child Kstudy, The test 
method, properly termed, however, as it has heeu developed 
and brought nearer to perfection by the modern |)aper and 
pencil psychologist is of much more recent origin and is rapidly 
becoming a science unto itself. 

More recently the staid study ot education has turned to 
the test methods for a solution of many i)ractical pi‘ol)lenis 
in educational procedure in an experimental manner, Still 
more recently sociology has adapted this mlij-hod to its subject 
matter and much is to be expected from ’its application in 
this field. 

The Great War precipitated the paper and pencil psychol¬ 
ogist into a popularity and an esteem scarcely anticipated by 
the most enthusiastic advocate. In the |)eriod of reconstruc¬ 
tion a deluge of tests has appeared, well nigh 5w;uni)ing the 
worker ai\d the student in the onslaught of tests of this and 
that. The progress of educational tests has heen le.ss stimu¬ 
lated by the war impetus. Their development has been more 
gradual and perhaps more normal but still they are receiving 
increasing and just recognition and arc being turned out in, 
increasing numbers. Truly wc are well into the test era. 

It is not my purpose in this brief paper to cast a critical 
eye upon paper and pencil psychology, education, and sociology. 
Measured in terms of practical results much can be said for 
them, Viewed from other angles their hues arc .not nearly 
so roseate. For the present I must confine my remarks to 
another aspect of the test method which .seems to he largely 
overlooked. 

Under the urge to devise new tests and assist in the .stand¬ 
ardization of recent tests it lias become the rpiitc common 
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practice for the instructor to use his students not alone for 
contributing data but to lend a hand in the scoring and tabu¬ 
lating of the results. The pedagogical value of such procedure 
is at least nebulous if not positively doubtful. Certain it is 
that those who contribute the data receive negative returns. 
Especially is this true when, through the kindness of fellow 
teachers in other departments, a test which pertains not at 
all to the work at hand is given for the avowed purpose of 
obtaining data sufficient for the establishment of norms, Such 
instances are not of infrequent occurrence. Due to the large 
number of datum necessary for adequate statistical treatment 
this undesirable aspect becomes much magnified. 

Those students who assist in the tabulation and the sta¬ 
tistical treatment of the data probably receive some experience 
which is of slight educational value but whether or not this 
justifies the exploitation of the masses is an .open question 
which it would seem should be decided In favor of the masses, 
The principal value attaching to the tabulation and treatment 
of data by the student is in training for research. Even this 
can be debated for plainly routine testing is not research nor 
is it especially conducive to a research attitude. As for the 
underclassmen—they are simply Versnehtierc. 

Faculty committees arc very prone to discuss ways and 
mc&ns for securing a better use of time by the students, To 
promote strict class attendance it is decreed that more than 
three absences from any course will cut into the credits 
received. Midweek parties are prohibited that the time of 
the students may not be utilized too largely in extra-curricular 
activities. It might he well for some of these committees to 
reflect likewise upon the instructors’ opportunities for securing 
a better use of the students' time in the class room. 

Now my thesis—one must always have a thesis nowadays 
—is that in a rather considerable and rapidly increasing num¬ 
ber of instances niiich of the college and normal school stu¬ 
dents’ time in the classroom is exploited by their teachers in 
paper and pencil research with but meagre, if any, returns 
to the student himself. As a judgment of value it would seem 
that if the students’ time and efforts are to be utilized in the 
classroom it should be in a manner that will bring the students 
at least some momentary satisfaction if not something of 
permanent educational value. 

I do not think I am making a mountain out of a mole hill, 
Anyone who has had an opportunity to observe the more 
recent progress and popularization of the test method cannot 
hnvp failed to note that this is a factor which is assuming 
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a large magnitude in i)ra])ortion to the pedagogical value which 
attaches to it in classroom routine. Almost innumerable ex¬ 
amples could be given of this exploitation of classroom time 
within a .single in.stitution but for reasons which are on the 
surface it is perhaps best not to be too definite in the present 
communication. There is also probably little need of dragging 
ill a large array of .statistics for every college teacher is or 
should be aware of tlie situation whicii 1 have brought up for 
consideration. One who is given to playing with figures might 
treat thi.s topic with results that would make the infant mor¬ 
tality charts furious with envy. 

Probabfy no one will take offense if I u.se myself as my 
“ horrible example." I have been guilty of using class time- 
lots of it—for paper and pencil research in gathering material 
which had not the remotest connection with their class work, 

I admit it blandly and complacently for I feel it has the stamp 
of social approval, The material I obtained, liowever, turned 
out to be extremely barren so now we refer to it as pre¬ 
liminary material. (Those who have been reading too much 
psychoanalysis please note.) To obtain this material three 
hundred students were detained from more worthwhile class 
work for a period of fifty minutes. The total time which 1 
thus exploited was fifteen thousand minutes or two hundred 
and fifty hours. Thus through the willingness of two in¬ 
structors and the dean of a college who aided and abetted me 
I consumed more than the equivalent of the time one student 
would have spent in class work during that quarter.* 

But my experience is by no means typical, If this prelim¬ 
inary material had warranted more thorough work I would 
probably not have stopped short of a thousand cases, I also 
would have used other and more advanced classes for the 
marking, tabulating, and correlating. Which, again translated 
into terras of the average students* classroom schedule would 
mean an entire year’s work I 

A great deal has been accomplished in a practical way 
witli the use of tests and their development should undoubtedly 
be furthered. Whether or not the college and university is 
the proper place for such development, however, is another 
question and one which I feel should be answered in the 
negative. The functions of a college or a university are 
instruction, furthering the sum total of human knowledge, 
and furthering its own interests. Let us take these up in 
the reverse order. 

* It is just that I state that this is not llie school from which I am 
writing. 
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One of the means I)y whicli an educational institution may 
further its own interests is to encourage its staff to cojitribute 
from time to lime to the sum total of human knowledge. 
Thins in some resftccts the last two functions can be com¬ 
bined in one work. With the advent of paper and i)eiicil 
research wimhi/c ilidu. it scenicd a.s if l]y a sudden stroke of 
providence it would l)e po.s.sible to combine all these functions 
am! fust! them together. Superficially this may be true. The 
first and all important function of an institution of higher 
learning, to which all other functions should be contributory, 
is iiisti-uctioii, And teaching is something far more than 
using classroom time. It is obvious that the development of 
tests—educational, psychological, sociological^ and what not— 
in the clas.s period is neither instruction nor education for 
the average run of underclassmen, The development of such 
methods and materials in the class room should be discour¬ 
aged excejit, jierhaps, in special classes organized solely for 
that purpose. 


COMMUNICATIONS AND NOTES 

A NEW LABORATORY IN CHILD PSYCHOLOGY 

The Iowa Child Welfare Research Station at The State Uiuversity 
has organized a Laboratory in Child Psychology' for experimental 
work with children from 2 to 4 years of age. A new four-roomed 
building has been comUructed and 24 children are now in attendance 
daily, in two sections from 9 to 12 o'clock, The laboratory is under 
the immediate direction of Dr, Bird T. Baldwin, Research Professor 
in Psychology, and Dr. Lorlc I Stecher, Research Assistant Pro¬ 
fessor, with graduate student assistants, 

Oct. 12, 1921 


E. T. BALDWIN 



lU K lie KK\*n-\\\S 

lijc~A .Vliiii.Y f>/ Ifit* .'/•□'W \>j l<fs.Unin.j f’tinl Bia.i}; (mi /’rojoiij- 
i\\<j Life. Hy Dr. SKrMiK VoHiVin-K. Diri.liir oi hNinriiiicmal Sur- 
l^cry ai lliii l-:i1nir.H«>ry oi I'hyi-iiploj'y nj llir (nUrj'i: 'Ic I'rance. 
Transljticil liy I'Ai’lyn lUvMwick VtiniutlY. I'tib. liy \i I'. DiiUcn, 

19M. Kid It. 

'Die cynic whn all ihi’oTirs nlii»nV jlir ttf li(e iiilo 

ihc scroll licai) iiiaile nii «( {\w. hmi o( Minr milk, l<ili;u;cn, uiaU liiiuocs 
or llie abslciuidu (ram (hem will i)'»l liavn mjcIi ease in ili.scerniiig 
flaws in llie i)f Dr. Si‘rj?t‘ VnmiuilJ- 
His i>lutloHratt!iic, evklenci: is lwr*i(j’ ilcliaialiK, ami liis vUal sla- 
lislic.s hardly nl llie sort whicli wc can vSiis(irci t»i liaviii^f tjccn jiiKulcd 
to fit lii.s thesis, 'i'he hunk is wrillen in MiinswlnU jioimlar style and 
the seriovvs slvidcnl wishes Kir iiUire detail as to lUc siUReud’s aiicra- 
live mcilioiJ and more exhaustive hisliTical stirv«-y (if Khin'lnlnr trans- 
phntntion, 

riic duel defect of Ihc vidtinie is Us omission of lefcreiiccs lo 
works ul well'kiioivn American snrjjcciiis who hnt’C for at least six 
years acuially iicrformed llicsc uiierniions Mitcc-ssfiilly im liviinM 
patients, The anlhor's work, however, was carried on cliietly with 
lower animals sncli as rams and Koals, Xevcrlliok'ss the hook is broad 
in conception il not wholly so in execution. 

In his first chajitcr he reviews the inverse ruhtliun of hiufjevily lo 
organic per lection in the animal svHcS. 

The second dcahs with the true cause of svnilily, vi?.. llui in'rsisUinci* in 
our organism of the primitivenoii-spccialized cellsiurapafile of perfonn- 
ing the functions Of spcctaliacd cel|.s, di.sorgai]i;:iiig llii.-iii and nrrcsliiig 
life. These primitive or conjunelive cells are originally imlisiumsahlelo 
ihcbodyandwccamKiLrlcsiroytltcm. Kailier must wc try lo iiuKlrraie 
their tendency to lApid inulliplication hy iiKTCii.sing llio vital oiicrfiy 
of specialized cells, the sex glands offering the greatest smiri-.e of such 
energy. By way ul illastralion the author cites the mental and [iliysl- 
cal ciTects of the removal of these Klnnd.s in die case of iniimchs, and 
in contrast the examples of men of gmins wht>se svx fuuctinns and 
artistic productivity were .still vigorous very laU'. in life, 

Chapter V expinins the failure of tlie ilrown-Segimrd mellioil of 
mjcctiou in the defective means of preserving Uk extract, aiul pre¬ 
sents the consequent arguments for the superiority of the graft inctliod, 
Then follows Voronoff’s report to the I’rcncli Surgical Congress in 
1912 of a lamb born of a ewe whose ovaries had been removed and 
replaced with others. In 1919 he reported grafting te.sticlcs upon 
females giving male characteristics and vice versa, grafting testicles 
on castrated males and aged males followed by disappearance of their 
infirmities, resioi'atioii of reproductive power and prolongation of life 
many years beyond that ever hitherto recorded for such animals. 

Ill conclii.sion he calls attention lo the scientific possibility as yet not 
legally sanctioned, of securing human glands (rom men killed by acci¬ 
dent or from executed crimmals, because glands may bo kept alive 
for weeks in refrigerators ol zero temperature. Hut failing this a 
substitute for the human thyroid is found in that of tliu higher .simian, 
The identity of secretions and effect of their action on other than the 
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same species is dcscribcil. To be specific, a patient whose thyroid 
mechanism at birth was devoid of blemish had measles at eight years 
resulting in myxoeclcma and imbecility. After nnicli experimentation 
with injection and thyroid tablets, tbe continuance, suspension and 
rcsinnj)tion of such medication, a graft from an ape brought a com¬ 
plete recovery and menial awakening. Other interesting examples are 
reported and finally emphasis laid on the service of augmenting in¬ 
ternal secretions of persons the usefulness of whose acquired experi¬ 
ence and accumnlaled knowledge i.s enhanced by prolonged life and 
stimulation to iiuetlecliial work. 

'flic aiipendix comaln.s the findings reported to the Biological Society 
of detailed microscopic examination made by M. Eel Retterer upon 
Dr. Voronoff’s gra/t.s. 

yassar Colleije. mihia.m c. goui.d. 

A Study of the Menial Life of the Child. By Von Hug-Hellncuth, H. 
Translated by James J. Putnam and Mabel Stevens. Nervous 
and Mental Disease Pub. Co., 1919. 154 p. 

This monograph docs not claim to represent the outcome of a 
judicial weighing of all the factors that go to make the infant and 
child what they are, .says Dr. Putnam in his preface, but it describes 
a certain very important group of factors that make up the sexuality 
of chiklliood, 

The author in a way disarms the critic fay acknowledging the use- 
fiilnes.s of other’s modes of clas.sification and choice of emphasis, by 
recognizing objections to her own plan of treatment and warning 
that the very special mental tendencies she describes as if existing 
incicpeiulently, in sharply defined epochs of childhood in point of fact 
however, run on through the whole duration of childhood. In no 
sense is the suppo.sition justified that she conceives of the child’s life 
as a thing marked off into periods on the very arbitrary basis she has 
adopted for convenience, namely, the nursing period, the play period, 
and (he period of serious study. 

Dr, Mellnnitli writes In a highly popular style, using for illustrative 
material her own nephew and many observations of Preycr, Shinn, 
Scupin and .Sully, who have studied the child by the biographical 
inetliod but not the Freudian interpretation. Stern and G. Stanley 
Hall arc additional sources, but there is little or no reference to further 
contemporary invc,stigatiojj. 

Whatever our views concerning the acceptability of the Freudian 
accent on the entire gamut of situations and response in childhood, 
no reader can tail to grant the universality of mo.st of the observed 
behaviour on wiiicli .she conimcats. We are not so ready to admit all 
of tlic author’s generalizations whose logic is glaringly open to attack 
by experimentalists who have contradictory data. 


Child behaviour. A critical and ereperitnenlal sindy of young children 
by the viclliod of conditioned reflexes. By Flouence Mateer. 
Badger, 191H. 239 p. 

This is a tcclinical volume dealing with (he Pavlov Method which 
was first aiiplicd to normal children by Krasnogorski in studying the 
devcloiiment anil clecadencc of conditioned reflexes and inhibitions in 
.sucklings and young cliilclrcii, later to cases of neuropathic and fecble- 
niincled children. 
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The aulhor criliciics Krasnorgorski's accuuut q{ Uis experiments {or 
its serious omissions amt says '* the claims made by Krasnogorski [or 
his method and fuidiug? arc so gi<*al that a verification or disproof 
ol tlieiJi seems to be (IcmandcJ from the standpoint of botli experi¬ 
mental and cliiiieal psychology. If die mclliod is so easily and accu¬ 
rately applicable anti allows .so many variations, it opens up to tlie 
experimcnlalisl a most proinhsing avenue ol attack upon tlie infant 
miml. If it diflereiitiate.s with such accuracy the defective and patlio- 
genic child white lie is still young enough for preventive education 
and corrective tUcrupy to have a chance it will revolutionize our present 
clinical methods." It is tins that Dr. Matcer seeks to ascertain by a 
modified melUodology and techiii(nic. She describes in detail licr pro¬ 
cedure of procuring the SO un.selcctcd normal children under 1 years 
of age in a village, the cstaWisluncnt of rapport, the activities pre- 
liininary to the e.xpcriincRlation, the social, hereditary pliysiological 
study of the subjects, the other groups of defective chiUlrcii in the 
Mass, State School for Feebleminded and of suspected or observation 
cases simili'arly tested and the additional extensive sliulics she made 
of individual children. 

Preliminary e.vperiinenis upon a few .sHbjccls were made with the 
aim of studying and iindcrsl'anding the method itself. A series of 
standard clinic tests for delermiiialion of mental levels were used 
sLicli as the Goddard Revision of the Binct Scale, the Yerkes Point 
Scidcp Healy Boards, the Goddard adaptation and form hoards, 
Kymograph records were then made of movcincnts in establishing 
condilioiicd opening of the mouth through n culaiieoiJ.‘> stimulation of 
the inner side of the right atm above the cUmjw, originally associated 
with feeding sweetened water or candy. Specificity and discritniuatioii 
of cntaiicoiis stimuli were studied in the same manner. 

The main experimental results arc as follows* (1) il-'J trials neces¬ 
sary in normal children to form a scnsury-iiiulor association, 3-Ifl in 
defectives. The iiece.ssary number decreases as age increa.ses iip lo 
60 months. Under two years boys are more rapid than girhs, abova 
two years the order is reversed. The iitiniber of trials varies more 
among girls than boys. The rapidity of learning or iic(iniring a con¬ 
ditioned reflex corrclatc-s with intelligence. 

(2) The number of trials necessary to ahlain memorial refunction- 
ing after an interval of 24 hours is from 2-7. 70% of the normal 
subjects reacted at once; 57% of defectives with 2 trials, the re.st 3-7. 

(3) The most rapid learners retain best. Girls are the most rapid. 

(4) The number of trials necessary to effect unlearning of an 
associative act when conditioning stimulus is absent is 3-12 for nor¬ 
mals, 8'2l for dcicctivcs. The number decreases as age increases, 
and mimbcr of trials for learning increases. Boys are most rapid. 

(5) No perceptible difference in children of all age.s or either sex 
in number of trials necessary to correct the unlearning and restore 
rcfunctioning of first as.sociations. 

The autlior makes no claim of finality in her fiiuling, hut point.? out 
their significance in our progress towards the use of objcclu-i; luctliods 
of child study, 

She does not advocate their .substitution for other clinical iiictliods, 
but simply tlicir addition because our infomiation concerning the 
organism becomes more certain hy studying the variations of behaviour 
under definitely ascertained conditions of stimulation. 

To quote Mhis Matecr “ Psychogcnelic or biograi)hical studies were 
and are valuable. They have been the pioneer path-breakers that 
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indicale the extent of the problem confronting us, but now exact 
dermitizalion of facts demands quantitative studies under controlled 
experimental conditions and an unbiassed presentation of the results 
obtained." However she warns against inferring too much from 
arbitrary situations, cold manipulation, and forgetfulness of the child 
as on individual. 

Her survey of the history and results of child study up to the 
present is ihoroiigl), yet admirably concise. 

yassar Colh'(tc miriam c. could. 

// Study of IVomcu DelinqunHs in New Vork Slate. By Mabel R. 
I'laiNAM), Maiiv IL S. Havks and Almena Dowley, with a statis¬ 
tical chapter by Beardsley Ruml and a preface by Katherine Re- 
inent Davis, Publication of the Bureau of Social HyEieno N. Y. 
The Century Co., 1920. 542 p. ’ 

'riii.s is the first extensive study of women delinquents given expert 
slaLi.slical treatment with modern methods. Its 225 tables are critically 
analyzed and conclusions summarized at the end of each chapter, 
making llie work .satisfying alike to readers with or without a thorough 
comprehension of the technique used. 

Unfortunately tlio data are confined to mental capacity and the main 
fads, of personal and environmental history, because adequate data 
for physical and medical facts could not be obtained. 

'I'hc grcnip.s studied were (1) N. Y. State Reformatory women be¬ 
tween the ages of 16 and 30 convicted of felonies and misdemeanors; 
(2) Auburn State Prison felons; (3) Magdalen Home Sex offenders; 
(4) N. Y. County Penitentiary; (5) Workhouse, and (6) Women’s 
Night Court case.s. Inebriates were omitted because of inability to 
obtain accurate information from them, but this eliminates many men¬ 
tal <lcfeciivcs and therefore introduces a serious source of error. A 
furtber defect is the variation in time period over which cases in the 
different instittilions were examined. No control series for compari¬ 
son with the normal population was used and comparison with men 
criminals wiis futile bccau.se the offenses of male convicts arc not 
comparable. 

Mental condition was ascertained by the Dinct Simon 1911, Yerkes, 
Bridges and Stanford Revision Scales, the Wooley scries, some edu¬ 
cational and individual .standard tests of ability. Social investigations 
were niiulc lliroiiBli visits lo the home, relatives, employees and oilier 
agtticics having knowledge of the offender. A correlation of .38 wa.s 
found licLwcen delinquency and intelligence, also significant correla¬ 
tions between mental capacity and type of occupation, mental capacity 
and earning capacity, age and number of previous convictions, age at 
first conviction and condition of the home. 

No correlation was found between age of leaving school and age of 
first conviction, nor between grade reached hi school and number of 
convictions. Lack of education, therefore, is not responsible for 
delinquency. 

Fnrllierinore, the popular conception that low and irregular wages 
are responsible finds no confirinalioii here, for a positive correlation 
could not be fonmt between earning capacity and lumibcr of convictions. 

Foreign white women made up a .smaller percentage in each insti- 
tiMional grou() than is present in the population as a whole, yet the 
offenses of llie foreign delinquents were more scriou.s an the whole 
than those of tlio natives. 
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There were more domestic workers in the group than in the general 
population and a lower average standard of education among them 
than in the other occupations represented. The older women had a 
lower grade of education than that reached by the younger eases. 

No relation appeared between iiilclligcncc and liahitual ufic of alco' 
hoi, drugs or cigarettes, Init the pro.stitulcs were distiiiclly menially 
inferior to those whose crimes were against properly. 

In 15.9% of the deIin(|uciU’s families some otlicr inenibcr had been 
convicted of crime, but the data was loo inatletjualc to enter into a 
study of liereditary aspects, Most of them were from .'iclf-.supporling 
families and born of parctils not at age cxlrcmcs, 

In several particulars the findings arc in snb.strintial agreement with 
those of Goring’s figures for the English convict, but tlie aiilliors are 
cautious in their deductions and fully aware of the inconclusivencss of 
their evidence, miriam c, gout.d. 

Vassar College. 
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